Max level shown:
12024-12-18T22:15:01.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc035c2a-21cb-46d4-a261-29cc4a8a348b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22024-12-18T22:15:01.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc035c2a-21cb-46d4-a261-29cc4a8a348b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32024-12-18T22:15:01.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc035c2a-21cb-46d4-a261-29cc4a8a348b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
42024-12-18T22:15:02.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16106320-20a0-49a1-88b6-0f94fd52ee82 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52024-12-18T22:15:02.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16106320-20a0-49a1-88b6-0f94fd52ee82 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
62024-12-18T22:15:02.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16106320-20a0-49a1-88b6-0f94fd52ee82 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
72024-12-18T22:15:03.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ceb6b726-2687-4324-bc04-3e4b539a49c2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
82024-12-18T22:15:03.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ceb6b726-2687-4324-bc04-3e4b539a49c2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
92024-12-18T22:15:03.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ceb6b726-2687-4324-bc04-3e4b539a49c2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
102024-12-18T22:15:03.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
112024-12-18T22:15:03.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122024-12-18T22:15:03.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
132024-12-18T22:15:03.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142024-12-18T22:15:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152024-12-18T22:15:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
162024-12-18T22:15:03.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
172024-12-18T22:15:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
182024-12-18T22:15:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192024-12-18T22:15:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202024-12-18T22:15:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
212024-12-18T22:15:03.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
222024-12-18T22:15:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
232024-12-18T22:15:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
242024-12-18T22:15:03.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252024-12-18T22:15:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262024-12-18T22:15:03.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
272024-12-18T22:15:03.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
282024-12-18T22:15:03.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.811842ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
292024-12-18T22:15:03.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
302024-12-18T22:15:03.972ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.130085ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
312024-12-18T22:15:04.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 563beba5-7bb2-476e-8f7e-851657c9f907 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
322024-12-18T22:15:04.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 563beba5-7bb2-476e-8f7e-851657c9f907 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
332024-12-18T22:15:04.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 563beba5-7bb2-476e-8f7e-851657c9f907 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
342024-12-18T22:15:05.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9d96394-f139-415c-996f-bd47e7df6d16 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
352024-12-18T22:15:05.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9d96394-f139-415c-996f-bd47e7df6d16 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
362024-12-18T22:15:05.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9d96394-f139-415c-996f-bd47e7df6d16 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
372024-12-18T22:15:06.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1b444303-2fe4-43ba-8795-d4416a816442 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
382024-12-18T22:15:06.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1b444303-2fe4-43ba-8795-d4416a816442 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
392024-12-18T22:15:06.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1b444303-2fe4-43ba-8795-d4416a816442 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
402024-12-18T22:15:07.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26c43a13-1076-4d60-ab0f-944f4d8c58e1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
412024-12-18T22:15:07.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26c43a13-1076-4d60-ab0f-944f4d8c58e1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
422024-12-18T22:15:07.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26c43a13-1076-4d60-ab0f-944f4d8c58e1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
432024-12-18T22:15:08.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7750056c-697d-4902-ae42-fd76e0b01894 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
442024-12-18T22:15:08.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7750056c-697d-4902-ae42-fd76e0b01894 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
452024-12-18T22:15:08.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7750056c-697d-4902-ae42-fd76e0b01894 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
462024-12-18T22:15:08.929ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::5]:32222/node/id", source: TimedOut })
472024-12-18T22:15:08.930ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.046685636s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone ce02eff6-97d3-45a9-b8cb-2574fd7d1376 at http://[fd00:1122:3344:101::5]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::5]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::5]:32222/node/id): operation timed out","zone_id":"ce02eff6-97d3-45a9-b8cb-2574fd7d1376"}],"nsuccess":4}
482024-12-18T22:15:09.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d03dc68-43d2-4f10-a866-b58067fdc46d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
492024-12-18T22:15:09.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d03dc68-43d2-4f10-a866-b58067fdc46d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
502024-12-18T22:15:09.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d03dc68-43d2-4f10-a866-b58067fdc46d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
512024-12-18T22:15:10.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d868ca-64fe-4cb2-b7ad-9905dd7fd087 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
522024-12-18T22:15:10.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d868ca-64fe-4cb2-b7ad-9905dd7fd087 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
532024-12-18T22:15:10.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d868ca-64fe-4cb2-b7ad-9905dd7fd087 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
542024-12-18T22:15:11.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05ccd46e-a9f2-4248-b2c5-6f42410a301e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
552024-12-18T22:15:11.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05ccd46e-a9f2-4248-b2c5-6f42410a301e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
562024-12-18T22:15:11.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05ccd46e-a9f2-4248-b2c5-6f42410a301e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
572024-12-18T22:15:11.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 79ba5ab0-ce12-4583-9a2f-470a2f437b6c roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
582024-12-18T22:15:11.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 79ba5ab0-ce12-4583-9a2f-470a2f437b6c resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
592024-12-18T22:15:11.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 79ba5ab0-ce12-4583-9a2f-470a2f437b6c response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
602024-12-18T22:15:11.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 6303a396-e1a3-402c-ab75-02e3a6bf2f94 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
612024-12-18T22:15:11.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 6303a396-e1a3-402c-ab75-02e3a6bf2f94 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
622024-12-18T22:15:11.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 6303a396-e1a3-402c-ab75-02e3a6bf2f94 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
632024-12-18T22:15:12.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7461aaec-4a2f-40dd-8d8c-ec021c6f4eb1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
642024-12-18T22:15:12.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7461aaec-4a2f-40dd-8d8c-ec021c6f4eb1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
652024-12-18T22:15:12.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7461aaec-4a2f-40dd-8d8c-ec021c6f4eb1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
662024-12-18T22:15:13.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 3422df7d-6353-429b-ad2a-09a451c022c2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
672024-12-18T22:15:13.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 3422df7d-6353-429b-ad2a-09a451c022c2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
682024-12-18T22:15:13.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 3422df7d-6353-429b-ad2a-09a451c022c2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
692024-12-18T22:15:13.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 25c5a5c1-4572-47cf-a6ff-bdcc2892a7fa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
702024-12-18T22:15:13.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 25c5a5c1-4572-47cf-a6ff-bdcc2892a7fa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
712024-12-18T22:15:13.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 25c5a5c1-4572-47cf-a6ff-bdcc2892a7fa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
722024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
732024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
742024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
752024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
762024-12-18T22:15:13.790ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
772024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 14.57\u{b5}s iteration = 3 status = {"error":"no config"}
782024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
792024-12-18T22:15:13.790ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
802024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
812024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
822024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
832024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
842024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
852024-12-18T22:15:13.790ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:05:13.790867427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
862024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
872024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
882024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
892024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
902024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
912024-12-18T22:15:13.790ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
922024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
932024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.71\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
942024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
952024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
962024-12-18T22:15:13.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
972024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
982024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
992024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1002024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
1012024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1022024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
1032024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
1042024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1052024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
1062024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1072024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
1082024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1092024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
1102024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1112024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
1122024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
1132024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
1142024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1152024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
1162024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1172024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1182024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
1192024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1202024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1212024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
1222024-12-18T22:15:13.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1232024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
1242024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252024-12-18T22:15:13.791ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
1262024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 11.51\u{b5}s iteration = 3 status = {"error":"no config"}
1272024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
1282024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
1292024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
1302024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1312024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1322024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1332024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
1342024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1352024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
1362024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1372024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1382024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1392024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1402024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1412024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1422024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1432024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1442024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1452024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1462024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1472024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1482024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1492024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1502024-12-18T22:15:13.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1004, tv_nsec: 416148504 } })
1512024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1522024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1532024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1542024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1552024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1562024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1572024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1582024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1592024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1602024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1612024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1622024-12-18T22:15:13.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1004, tv_nsec: 416303847 } })
1632024-12-18T22:15:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1642024-12-18T22:15:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1652024-12-18T22:15:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.288955ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1662024-12-18T22:15:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1672024-12-18T22:15:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.451328ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1682024-12-18T22:15:13.793ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.100851ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
1692024-12-18T22:15:13.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1702024-12-18T22:15:13.794ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-12-18T22:15:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.130251ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1722024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1732024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1742024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1752024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1772024-12-18T22:15:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782024-12-18T22:15:13.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-12-18T22:15:13.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802024-12-18T22:15:13.800ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:05:13.790867427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1812024-12-18T22:15:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.806203ms iteration = 2 status = {"expiration":"2024-12-18T22:05:13.790867427Z","pruned":[]}
1822024-12-18T22:15:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1832024-12-18T22:15:13.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1842024-12-18T22:15:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1852024-12-18T22:15:13.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1862024-12-18T22:15:13.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1872024-12-18T22:15:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1882024-12-18T22:15:13.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1892024-12-18T22:15:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1902024-12-18T22:15:13.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1004, tv_nsec: 430900584 } })
1912024-12-18T22:15:13.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1922024-12-18T22:15:13.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1004, tv_nsec: 431388763 } })
1932024-12-18T22:15:13.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1942024-12-18T22:15:13.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1952024-12-18T22:15:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1962024-12-18T22:15:13.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1972024-12-18T22:15:13.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1982024-12-18T22:15:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1992024-12-18T22:15:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2002024-12-18T22:15:13.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2012024-12-18T22:15:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2022024-12-18T22:15:13.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2032024-12-18T22:15:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2042024-12-18T22:15:13.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-12-18T22:15:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2062024-12-18T22:15:13.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2072024-12-18T22:15:13.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082024-12-18T22:15:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2092024-12-18T22:15:13.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2102024-12-18T22:15:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2112024-12-18T22:15:13.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2122024-12-18T22:15:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2132024-12-18T22:15:13.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2142024-12-18T22:15:13.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152024-12-18T22:15:13.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162024-12-18T22:15:13.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2172024-12-18T22:15:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2182024-12-18T22:15:13.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.371425ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
2192024-12-18T22:15:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2202024-12-18T22:15:13.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2212024-12-18T22:15:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2222024-12-18T22:15:13.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-12-18T22:15:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2242024-12-18T22:15:13.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2252024-12-18T22:15:13.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2262024-12-18T22:15:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2272024-12-18T22:15:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2282024-12-18T22:15:13.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2292024-12-18T22:15:13.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2302024-12-18T22:15:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2312024-12-18T22:15:13.853ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2322024-12-18T22:15:13.853ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2332024-12-18T22:15:13.853ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.456065ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2342024-12-18T22:15:13.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.081397ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2352024-12-18T22:15:13.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362024-12-18T22:15:13.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372024-12-18T22:15:13.857ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2382024-12-18T22:15:13.857ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2392024-12-18T22:15:13.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2402024-12-18T22:15:13.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.612707ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
2412024-12-18T22:15:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2422024-12-18T22:15:13.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2432024-12-18T22:15:13.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2442024-12-18T22:15:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2452024-12-18T22:15:13.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2462024-12-18T22:15:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2472024-12-18T22:15:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2482024-12-18T22:15:13.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2492024-12-18T22:15:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2502024-12-18T22:15:13.861ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2512024-12-18T22:15:13.861ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2522024-12-18T22:15:13.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2532024-12-18T22:15:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2542024-12-18T22:15:13.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-12-18T22:15:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2562024-12-18T22:15:13.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572024-12-18T22:15:13.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2582024-12-18T22:15:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592024-12-18T22:15:13.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2602024-12-18T22:15:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2612024-12-18T22:15:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
2622024-12-18T22:15:13.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2632024-12-18T22:15:13.869ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2642024-12-18T22:15:13.869ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2652024-12-18T22:15:13.869ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.734795ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2662024-12-18T22:15:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2672024-12-18T22:15:13.872ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1004, tv_nsec: 496811627 } })
2682024-12-18T22:15:13.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
2692024-12-18T22:15:13.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2702024-12-18T22:15:13.876ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2712024-12-18T22:15:13.876ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7973ad3c-2b0c-48c6-bf9d-5ad691c24b1d", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
2722024-12-18T22:15:13.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2732024-12-18T22:15:13.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2742024-12-18T22:15:13.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
2752024-12-18T22:15:13.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.440595ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
2762024-12-18T22:15:13.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2772024-12-18T22:15:13.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2782024-12-18T22:15:13.891ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2792024-12-18T22:15:13.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.708716ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2802024-12-18T22:15:13.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2812024-12-18T22:15:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2822024-12-18T22:15:13.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.370378ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2832024-12-18T22:15:13.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2842024-12-18T22:15:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2852024-12-18T22:15:13.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.674113ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2862024-12-18T22:15:13.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2872024-12-18T22:15:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2882024-12-18T22:15:13.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2892024-12-18T22:15:13.898ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2902024-12-18T22:15:13.899ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac4e5252-c15c-4de8-b9f6-a81e315ee0e5", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
2912024-12-18T22:15:13.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2922024-12-18T22:15:13.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2932024-12-18T22:15:13.899ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.791274ms iteration = 5 status = {"physical_disks_added":0}
2942024-12-18T22:15:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2952024-12-18T22:15:13.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2962024-12-18T22:15:13.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-12-18T22:15:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
2982024-12-18T22:15:13.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2992024-12-18T22:15:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3002024-12-18T22:15:13.906ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3012024-12-18T22:15:13.906ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3022024-12-18T22:15:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.421835ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3032024-12-18T22:15:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.116268ms iteration = 3 status = 0
3042024-12-18T22:15:13.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.130049ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3052024-12-18T22:15:13.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3062024-12-18T22:15:13.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3072024-12-18T22:15:13.939ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3082024-12-18T22:15:13.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3092024-12-18T22:15:13.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3102024-12-18T22:15:13.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3112024-12-18T22:15:13.960ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 169.849033ms iteration = 3 status = {}
3122024-12-18T22:15:13.977ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
3132024-12-18T22:15:13.977ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.462088ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3142024-12-18T22:15:13.979ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3152024-12-18T22:15:13.979ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3162024-12-18T22:15:13.979ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3172024-12-18T22:15:13.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3182024-12-18T22:15:13.979ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3192024-12-18T22:15:13.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3202024-12-18T22:15:13.979ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "31d14a69-cc38-45c5-8bb6-60820b7cf688", "content-length": "1", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
3212024-12-18T22:15:13.980ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3222024-12-18T22:15:13.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3232024-12-18T22:15:13.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
3242024-12-18T22:15:13.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3252024-12-18T22:15:13.984ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e35934ae-f147-4e30-9629-c7a323dfe79b", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
3262024-12-18T22:15:13.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3272024-12-18T22:15:13.985ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3282024-12-18T22:15:13.985ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3292024-12-18T22:15:13.985ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3302024-12-18T22:15:13.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3312024-12-18T22:15:13.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3322024-12-18T22:15:13.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
3332024-12-18T22:15:13.992ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3342024-12-18T22:15:13.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 201.188887ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3352024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
3362024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
3372024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
3382024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
3392024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
3402024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
3412024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
3422024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
3432024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
3442024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
3452024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
3462024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
3472024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
3482024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
3492024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
3502024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
3512024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
3522024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
3532024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
3542024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
3552024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
3562024-12-18T22:15:13.992ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
3572024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
3582024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
3592024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
3602024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
3612024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
3622024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
3632024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
3642024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
3652024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
3662024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
3672024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
3682024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
3692024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
3702024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
3712024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
3722024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
3732024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
3742024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
3752024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
3762024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
3772024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
3782024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
3792024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
3802024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
3812024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
3822024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
3832024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
3842024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
3852024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
3862024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
3872024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
3882024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
3892024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
3902024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
3912024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
3922024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
3932024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
3942024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
3952024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
3962024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
3972024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
3982024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
3992024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
4002024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
4012024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
4022024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
4032024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
4042024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
4052024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
4062024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
4072024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
4082024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
4092024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
4102024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
4112024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
4122024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
4132024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
4142024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
4152024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
4162024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
4172024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
4182024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
4192024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
4202024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
4212024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
4222024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
4232024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
4242024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
4252024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
4262024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
4272024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
4282024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
4292024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
4302024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
4312024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
4322024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
4332024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
4342024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
4352024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
4362024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
4372024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
4382024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
4392024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
4402024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
4412024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
4422024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
4432024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
4442024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
4452024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
4462024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
4472024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
4482024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
4492024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
4502024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
4512024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
4522024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
4532024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
4542024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
4552024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
4562024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
4572024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
4582024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
4592024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
4602024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
4612024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
4622024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
4632024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
4642024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
4652024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
4662024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
4672024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
4682024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
4692024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
4702024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
4712024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
4722024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
4732024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
4742024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
4752024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
4762024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
4772024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
4782024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
4792024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
4802024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
4812024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
4822024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
4832024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
4842024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
4852024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
4862024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
4872024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
4882024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
4892024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
4902024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
4912024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
4922024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
4932024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
4942024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
4952024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
4962024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
4972024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
4982024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
4992024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
5002024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
5012024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
5022024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
5032024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
5042024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
5052024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
5062024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
5072024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
5082024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
5092024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
5102024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
5112024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
5122024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
5132024-12-18T22:15:13.993ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
5142024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
5152024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
5162024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
5172024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
5182024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
5192024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
5202024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
5212024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
5222024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
5232024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
5242024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
5252024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
5262024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
5272024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
5282024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
5292024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
5302024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
5312024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
5322024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
5332024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
5342024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
5352024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
5362024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
5372024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
5382024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
5392024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
5402024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
5412024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
5422024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
5432024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
5442024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
5452024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
5462024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
5472024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
5482024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
5492024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
5502024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
5512024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
5522024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
5532024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
5542024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
5552024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
5562024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
5572024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
5582024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
5592024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
5602024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
5612024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
5622024-12-18T22:15:13.994ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
5632024-12-18T22:15:13.994ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
5642024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
5652024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
5662024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
5672024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
5682024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
5692024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
5702024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
5712024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
5722024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
5732024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
5742024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
5752024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
5762024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
5772024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
5782024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
5792024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
5802024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
5812024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
5822024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
5832024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
5842024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
5852024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
5862024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
5872024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
5882024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
5892024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
5902024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
5912024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
5922024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
5932024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
5942024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
5952024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
5962024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
5972024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
5982024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
5992024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
6002024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
6012024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
6022024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
6032024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
6042024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
6052024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
6062024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
6072024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
6082024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
6092024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
6102024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
6112024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
6122024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
6132024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
6142024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
6152024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
6162024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
6172024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
6182024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
6192024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
6202024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
6212024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
6222024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
6232024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
6242024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
6252024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
6262024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
6272024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
6282024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
6292024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
6302024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
6312024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
6322024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
6332024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
6342024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
6352024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
6362024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
6372024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
6382024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
6392024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
6402024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
6412024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
6422024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
6432024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
6442024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
6452024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
6462024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
6472024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
6482024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
6492024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
6502024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
6512024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
6522024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
6532024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
6542024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
6552024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
6562024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
6572024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
6582024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
6592024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
6602024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
6612024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
6622024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
6632024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
6642024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
6652024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
6662024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
6672024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
6682024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
6692024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
6702024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
6712024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
6722024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
6732024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
6742024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
6752024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
6762024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
6772024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
6782024-12-18T22:15:13.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
6792024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
6802024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
6812024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
6822024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
6832024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
6842024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
6852024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
6862024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
6872024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
6882024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
6892024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
6902024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
6912024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
6922024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
6932024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
6942024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
6952024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
6962024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
6972024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
6982024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
6992024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
7002024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
7012024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
7022024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
7032024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
7042024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
7052024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
7062024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
7072024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
7082024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
7092024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
7102024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
7112024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
7122024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
7132024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
7142024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
7152024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
7162024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
7172024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
7182024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
7192024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
7202024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
7212024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
7222024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
7232024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
7242024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
7252024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
7262024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
7272024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
7282024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
7292024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
7302024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
7312024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
7322024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
7332024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
7342024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
7352024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
7362024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
7372024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
7382024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
7392024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
7402024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
7412024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
7422024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
7432024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
7442024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
7452024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
7462024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
7472024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
7482024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
7492024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
7502024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
7512024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
7522024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
7532024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
7542024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
7552024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
7562024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
7572024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
7582024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
7592024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
7602024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
7612024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
7622024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
7632024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
7642024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
7652024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
7662024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
7672024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
7682024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
7692024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
7702024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
7712024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
7722024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
7732024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
7742024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
7752024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
7762024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
7772024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
7782024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
7792024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
7802024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
7812024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
7822024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
7832024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
7842024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
7852024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
7862024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
7872024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
7882024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
7892024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
7902024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
7912024-12-18T22:15:14.000ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
7922024-12-18T22:15:14.000ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
7932024-12-18T22:15:14.002ZDEBGnexus (nexus-producer-server): registered DTrace probes
7942024-12-18T22:15:14.006ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:55337 method = GET path = /{producer_id} versions = all
7952024-12-18T22:15:14.007ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:55337
7962024-12-18T22:15:14.007ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:55337
7972024-12-18T22:15:14.007ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:55337
7982024-12-18T22:15:14.007ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
7992024-12-18T22:15:14.007ZDEBGnexus (nexus-producer-server): starting producer registration task
8002024-12-18T22:15:14.007ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:55337 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
8012024-12-18T22:15:14.007ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
8022024-12-18T22:15:14.007ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
8032024-12-18T22:15:14.015ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8042024-12-18T22:15:14.015ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8052024-12-18T22:15:14.015ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a76b71d2-f175-439b-aad7-16f10450bae9", "content-length": "372", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
8062024-12-18T22:15:14.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072024-12-18T22:15:14.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082024-12-18T22:15:14.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8092024-12-18T22:15:14.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8102024-12-18T22:15:14.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112024-12-18T22:15:14.018ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.389642ms iteration = 3 status = null
8122024-12-18T22:15:14.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8132024-12-18T22:15:14.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8142024-12-18T22:15:14.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8152024-12-18T22:15:14.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8162024-12-18T22:15:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8172024-12-18T22:15:14.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8182024-12-18T22:15:14.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8192024-12-18T22:15:14.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8202024-12-18T22:15:14.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8212024-12-18T22:15:14.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8222024-12-18T22:15:14.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8232024-12-18T22:15:14.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8242024-12-18T22:15:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8252024-12-18T22:15:14.033ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8262024-12-18T22:15:14.033ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8272024-12-18T22:15:14.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "be173176-a710-4fd8-9d33-3307fe3e2413", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
8282024-12-18T22:15:14.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8292024-12-18T22:15:14.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8302024-12-18T22:15:14.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8312024-12-18T22:15:14.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8322024-12-18T22:15:14.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8332024-12-18T22:15:14.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8342024-12-18T22:15:14.043ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8352024-12-18T22:15:14.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8362024-12-18T22:15:14.043ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a28c9e12-67dc-4f67-9ee3-45a033893b0b", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
8372024-12-18T22:15:14.044ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.688227ms iteration = 3 status = {}
8382024-12-18T22:15:14.051ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
8392024-12-18T22:15:14.051ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
8402024-12-18T22:15:14.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8412024-12-18T22:15:14.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8422024-12-18T22:15:14.056ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
8432024-12-18T22:15:14.056ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
8442024-12-18T22:15:14.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8452024-12-18T22:15:14.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8462024-12-18T22:15:14.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472024-12-18T22:15:14.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8482024-12-18T22:15:14.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8492024-12-18T22:15:14.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8502024-12-18T22:15:14.063ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
8512024-12-18T22:15:14.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8522024-12-18T22:15:14.063ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
8532024-12-18T22:15:14.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 272.273582ms iteration = 2 status = {"generation":2}
8542024-12-18T22:15:14.063ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
8552024-12-18T22:15:14.068ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
8562024-12-18T22:15:14.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59006
8572024-12-18T22:15:14.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59006 req_id = 32b35b00-e2f0-4610-b1dd-ec33b4f7fa09 roles = RoleSet { roles: {} } uri = /metrics/producers
8582024-12-18T22:15:14.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59006 req_id = 32b35b00-e2f0-4610-b1dd-ec33b4f7fa09 resource = Database result = Ok(()) uri = /metrics/producers
8592024-12-18T22:15:14.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602024-12-18T22:15:14.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8612024-12-18T22:15:14.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8622024-12-18T22:15:14.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8632024-12-18T22:15:14.088ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8642024-12-18T22:15:14.088ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8652024-12-18T22:15:14.088ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
8662024-12-18T22:15:14.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 297.429465ms iteration = 2 status = {"generation":1}
8672024-12-18T22:15:14.088ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
8682024-12-18T22:15:14.115ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
8692024-12-18T22:15:14.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46908 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59006 req_id = 32b35b00-e2f0-4610-b1dd-ec33b4f7fa09 response_code = 201 uri = /metrics/producers
8702024-12-18T22:15:14.116ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "32b35b00-e2f0-4610-b1dd-ec33b4f7fa09", "content-length": "41", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
8712024-12-18T22:15:14.117ZDEBGnexus (producer-registration-task): registered with nexus successfully
8722024-12-18T22:15:14.117ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
8732024-12-18T22:15:14.158ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8742024-12-18T22:15:14.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8752024-12-18T22:15:14.197ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ac757c-038e-4194-9e72-a019c1669fff", "content-length": "691", "date": "Wed, 18 Dec 2024 22:15:13 GMT"} })
8762024-12-18T22:15:14.197ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8772024-12-18T22:15:14.197ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8782024-12-18T22:15:14.197ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8792024-12-18T22:15:14.199ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.035625ms iteration = 3 status = {}
8802024-12-18T22:15:14.257ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
8812024-12-18T22:15:14.257ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "029aed74-37db-40ea-b02b-8d26fcaa87f5", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8822024-12-18T22:15:14.258ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8832024-12-18T22:15:14.259ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "28cc58b9-4e14-41ca-bf8a-d4fe301b8451", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8842024-12-18T22:15:14.259ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8852024-12-18T22:15:14.261ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8862024-12-18T22:15:14.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 197.683558ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8872024-12-18T22:15:14.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8882024-12-18T22:15:14.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8892024-12-18T22:15:14.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8902024-12-18T22:15:14.350ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
8912024-12-18T22:15:14.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8922024-12-18T22:15:14.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8932024-12-18T22:15:14.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8942024-12-18T22:15:14.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
8952024-12-18T22:15:14.396ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e2105cf5-5f98-4795-9d0f-79f8fd228bee", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8962024-12-18T22:15:14.396ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8972024-12-18T22:15:14.397ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "13ded2ac-e73f-4f0e-9ee3-f02606725244", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8982024-12-18T22:15:14.397ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
8992024-12-18T22:15:14.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "897896cb-fcec-4b18-9de8-dc93b33b391a", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
9002024-12-18T22:15:14.398ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
9012024-12-18T22:15:14.399ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
9022024-12-18T22:15:14.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 311.064873ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
9032024-12-18T22:15:14.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79f4f806-9a2f-44ba-9967-4b8a2e703739 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9042024-12-18T22:15:14.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79f4f806-9a2f-44ba-9967-4b8a2e703739 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9052024-12-18T22:15:14.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79f4f806-9a2f-44ba-9967-4b8a2e703739 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9062024-12-18T22:15:14.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9072024-12-18T22:15:14.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1cbb6d5-5d37-4592-9e3f-bfb17be3dacb", "content-length": "134", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
9082024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
9092024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
9102024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9112024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9122024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9132024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9142024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9152024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9162024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9172024-12-18T22:15:14.532ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9182024-12-18T22:15:14.533ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
9192024-12-18T22:15:14.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9202024-12-18T22:15:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9212024-12-18T22:15:14.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9222024-12-18T22:15:14.535ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc5997fc-e5b2-49e7-8589-fbef952793ce", "content-length": "2", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
9232024-12-18T22:15:14.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9242024-12-18T22:15:14.535ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7b46593-3be2-49e2-88a6-8b471f8fd648", "content-length": "52", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
9252024-12-18T22:15:14.535ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
9262024-12-18T22:15:14.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9272024-12-18T22:15:14.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6ba2cb0a-e6af-4e70-a9ee-032b83d25363", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
9282024-12-18T22:15:14.627ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
9292024-12-18T22:15:14.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9302024-12-18T22:15:14.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cef7995a-a162-4533-ab20-67d5a0c6cf56", "content-length": "682", "date": "Wed, 18 Dec 2024 22:15:14 GMT"} })
9312024-12-18T22:15:14.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9322024-12-18T22:15:14.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9332024-12-18T22:15:14.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9342024-12-18T22:15:14.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9352024-12-18T22:15:14.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9362024-12-18T22:15:14.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9372024-12-18T22:15:14.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9382024-12-18T22:15:14.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9392024-12-18T22:15:14.646ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 855.966594ms iteration = 3 status = {}
9402024-12-18T22:15:15.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ea879bb-8f28-4498-8a6e-d74b69587d5f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9412024-12-18T22:15:15.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ea879bb-8f28-4498-8a6e-d74b69587d5f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9422024-12-18T22:15:15.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ea879bb-8f28-4498-8a6e-d74b69587d5f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9432024-12-18T22:15:16.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d245bbfa-666f-45f5-88fc-ed487475e5b8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9442024-12-18T22:15:16.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d245bbfa-666f-45f5-88fc-ed487475e5b8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9452024-12-18T22:15:16.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d245bbfa-666f-45f5-88fc-ed487475e5b8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9462024-12-18T22:15:17.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4796e42d-f6af-4196-91e6-3cbd9a32bd06 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9472024-12-18T22:15:17.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4796e42d-f6af-4196-91e6-3cbd9a32bd06 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9482024-12-18T22:15:17.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4796e42d-f6af-4196-91e6-3cbd9a32bd06 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9492024-12-18T22:15:18.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0cfd34a0-ab5c-44d0-8f46-30fc70be2e9a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9502024-12-18T22:15:18.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0cfd34a0-ab5c-44d0-8f46-30fc70be2e9a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9512024-12-18T22:15:18.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0cfd34a0-ab5c-44d0-8f46-30fc70be2e9a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9522024-12-18T22:15:19.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5397f0be-3676-4f40-8151-73ce2e9a6157 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9532024-12-18T22:15:19.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5397f0be-3676-4f40-8151-73ce2e9a6157 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9542024-12-18T22:15:19.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5397f0be-3676-4f40-8151-73ce2e9a6157 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9552024-12-18T22:15:20.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c2c66d4-e48e-4338-86c9-45cfb6afebec roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9562024-12-18T22:15:20.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c2c66d4-e48e-4338-86c9-45cfb6afebec resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9572024-12-18T22:15:20.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c2c66d4-e48e-4338-86c9-45cfb6afebec response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9582024-12-18T22:15:21.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf15de93-6acb-4fb7-a0be-46295020d185 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9592024-12-18T22:15:21.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf15de93-6acb-4fb7-a0be-46295020d185 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9602024-12-18T22:15:21.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf15de93-6acb-4fb7-a0be-46295020d185 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9612024-12-18T22:15:22.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c486e422-e969-40ac-b35e-a45bc99915e5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9622024-12-18T22:15:22.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c486e422-e969-40ac-b35e-a45bc99915e5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9632024-12-18T22:15:22.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c486e422-e969-40ac-b35e-a45bc99915e5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9642024-12-18T22:15:23.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35c85270-1642-4410-b39d-95db530f02ad roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9652024-12-18T22:15:23.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35c85270-1642-4410-b39d-95db530f02ad resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9662024-12-18T22:15:23.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35c85270-1642-4410-b39d-95db530f02ad response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9672024-12-18T22:15:23.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
9682024-12-18T22:15:23.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9692024-12-18T22:15:23.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
9702024-12-18T22:15:23.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9712024-12-18T22:15:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9722024-12-18T22:15:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9732024-12-18T22:15:23.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9742024-12-18T22:15:23.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9752024-12-18T22:15:23.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-12-18T22:15:23.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.050229ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9772024-12-18T22:15:23.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9782024-12-18T22:15:23.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9792024-12-18T22:15:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9802024-12-18T22:15:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9812024-12-18T22:15:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9822024-12-18T22:15:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9832024-12-18T22:15:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
9842024-12-18T22:15:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9852024-12-18T22:15:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9862024-12-18T22:15:23.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
9872024-12-18T22:15:23.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.536942ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
9882024-12-18T22:15:24.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e2cac26-aa9e-459b-beb6-9f9fa6e30c31 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9892024-12-18T22:15:24.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e2cac26-aa9e-459b-beb6-9f9fa6e30c31 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9902024-12-18T22:15:24.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e2cac26-aa9e-459b-beb6-9f9fa6e30c31 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9912024-12-18T22:15:25.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 893f47e9-ab8a-45e0-8bf1-5f0166dda935 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9922024-12-18T22:15:25.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 893f47e9-ab8a-45e0-8bf1-5f0166dda935 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9932024-12-18T22:15:25.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 893f47e9-ab8a-45e0-8bf1-5f0166dda935 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9942024-12-18T22:15:26.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 86178683-48cc-466f-9bf1-da58d97c35c4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9952024-12-18T22:15:26.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 86178683-48cc-466f-9bf1-da58d97c35c4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9962024-12-18T22:15:26.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 86178683-48cc-466f-9bf1-da58d97c35c4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9972024-12-18T22:15:27.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 78cdac6c-6d43-46ac-84bf-19270f042be8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9982024-12-18T22:15:27.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 78cdac6c-6d43-46ac-84bf-19270f042be8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
9992024-12-18T22:15:27.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 78cdac6c-6d43-46ac-84bf-19270f042be8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10002024-12-18T22:15:28.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5355dce-d467-49ee-ad8e-c47adcbd76b4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10012024-12-18T22:15:28.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5355dce-d467-49ee-ad8e-c47adcbd76b4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10022024-12-18T22:15:28.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5355dce-d467-49ee-ad8e-c47adcbd76b4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10032024-12-18T22:15:29.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cad00e4-4ffe-4a47-b19d-e67ced330833 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10042024-12-18T22:15:29.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cad00e4-4ffe-4a47-b19d-e67ced330833 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10052024-12-18T22:15:29.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cad00e4-4ffe-4a47-b19d-e67ced330833 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10062024-12-18T22:15:30.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50a3150c-e30d-4197-801e-ba92d9b853b1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10072024-12-18T22:15:30.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50a3150c-e30d-4197-801e-ba92d9b853b1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10082024-12-18T22:15:30.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50a3150c-e30d-4197-801e-ba92d9b853b1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10092024-12-18T22:15:31.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f233fdc-e3ca-4b01-a5c0-3f17118dbacd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10102024-12-18T22:15:31.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f233fdc-e3ca-4b01-a5c0-3f17118dbacd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10112024-12-18T22:15:31.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f233fdc-e3ca-4b01-a5c0-3f17118dbacd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10122024-12-18T22:15:32.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 42177d88-2a4e-460a-9d06-c22f237fd8d3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10132024-12-18T22:15:32.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 42177d88-2a4e-460a-9d06-c22f237fd8d3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10142024-12-18T22:15:32.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 42177d88-2a4e-460a-9d06-c22f237fd8d3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10152024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
10162024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
10172024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10182024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10192024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10202024-12-18T22:15:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10212024-12-18T22:15:33.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10222024-12-18T22:15:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10232024-12-18T22:15:33.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10242024-12-18T22:15:33.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.993719ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10252024-12-18T22:15:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10262024-12-18T22:15:33.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10272024-12-18T22:15:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10282024-12-18T22:15:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10292024-12-18T22:15:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10302024-12-18T22:15:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312024-12-18T22:15:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
10322024-12-18T22:15:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10332024-12-18T22:15:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10342024-12-18T22:15:33.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60f78d8c-e2f6-4579-9a1e-faee92398bd0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10352024-12-18T22:15:33.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60f78d8c-e2f6-4579-9a1e-faee92398bd0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10362024-12-18T22:15:33.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60f78d8c-e2f6-4579-9a1e-faee92398bd0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10372024-12-18T22:15:33.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
10382024-12-18T22:15:33.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.111972ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
10392024-12-18T22:15:34.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be51f0ae-30a2-47de-b709-d00a7543b67f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10402024-12-18T22:15:34.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be51f0ae-30a2-47de-b709-d00a7543b67f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10412024-12-18T22:15:34.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be51f0ae-30a2-47de-b709-d00a7543b67f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10422024-12-18T22:15:35.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99bb70ce-34b6-44f8-950e-5093ced27b6f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10432024-12-18T22:15:35.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99bb70ce-34b6-44f8-950e-5093ced27b6f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10442024-12-18T22:15:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99bb70ce-34b6-44f8-950e-5093ced27b6f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10452024-12-18T22:15:36.627ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:55337 remote_addr = [fd00:1122:3344:101::d]:52098
10462024-12-18T22:15:36.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5395 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 6cd57f33-eacd-4af5-b64e-d067138bdca1 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
10472024-12-18T22:15:36.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 764e24a7-2fb6-4c4d-a9e1-30567762978a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10482024-12-18T22:15:36.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 764e24a7-2fb6-4c4d-a9e1-30567762978a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10492024-12-18T22:15:36.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 764e24a7-2fb6-4c4d-a9e1-30567762978a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10502024-12-18T22:15:37.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07330fc4-cfa8-4eeb-aca0-0cab6b5d10ed roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10512024-12-18T22:15:37.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07330fc4-cfa8-4eeb-aca0-0cab6b5d10ed resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10522024-12-18T22:15:37.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07330fc4-cfa8-4eeb-aca0-0cab6b5d10ed response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10532024-12-18T22:15:39.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7b00c9e5-a504-440d-b737-dc805bd0c072 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10542024-12-18T22:15:39.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7b00c9e5-a504-440d-b737-dc805bd0c072 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10552024-12-18T22:15:39.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7b00c9e5-a504-440d-b737-dc805bd0c072 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10562024-12-18T22:15:40.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e18b229-63d4-4911-bf19-7870b55dad00 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10572024-12-18T22:15:40.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e18b229-63d4-4911-bf19-7870b55dad00 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10582024-12-18T22:15:40.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e18b229-63d4-4911-bf19-7870b55dad00 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10592024-12-18T22:15:41.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 980f72b9-59e6-41bc-8d30-7836a053e49f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10602024-12-18T22:15:41.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 980f72b9-59e6-41bc-8d30-7836a053e49f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10612024-12-18T22:15:41.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 980f72b9-59e6-41bc-8d30-7836a053e49f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10622024-12-18T22:15:41.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1190c6f0-eea0-48db-a3e1-12bebf20aa5b roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
10632024-12-18T22:15:41.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1190c6f0-eea0-48db-a3e1-12bebf20aa5b resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
10642024-12-18T22:15:41.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1190c6f0-eea0-48db-a3e1-12bebf20aa5b response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
10652024-12-18T22:15:41.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = c08cfca5-0bd0-4f39-970a-3368bb8cefa0 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
10662024-12-18T22:15:41.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = c08cfca5-0bd0-4f39-970a-3368bb8cefa0 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
10672024-12-18T22:15:41.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = c08cfca5-0bd0-4f39-970a-3368bb8cefa0 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
10682024-12-18T22:15:42.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 793a0703-3e58-49a8-9de1-cc1837535452 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10692024-12-18T22:15:42.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 793a0703-3e58-49a8-9de1-cc1837535452 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10702024-12-18T22:15:42.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 793a0703-3e58-49a8-9de1-cc1837535452 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10712024-12-18T22:15:43.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = a7340933-852f-42d4-a923-0cd1b1ba3449 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10722024-12-18T22:15:43.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = a7340933-852f-42d4-a923-0cd1b1ba3449 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10732024-12-18T22:15:43.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = a7340933-852f-42d4-a923-0cd1b1ba3449 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10742024-12-18T22:15:43.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d05f042a-d6a5-4ce6-bc3b-955bb3ec8094 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10752024-12-18T22:15:43.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d05f042a-d6a5-4ce6-bc3b-955bb3ec8094 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10762024-12-18T22:15:43.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d05f042a-d6a5-4ce6-bc3b-955bb3ec8094 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
10772024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
10782024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
10792024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10802024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10812024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
10822024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10832024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
10842024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
10852024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10862024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10872024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
10882024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
10892024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10902024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10912024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
10922024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10932024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
10942024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
10952024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10962024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10972024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
10982024-12-18T22:15:43.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10992024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11002024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
11012024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11022024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
11032024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11042024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
11052024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
11062024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11072024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
11082024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11092024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
11102024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11112024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11122024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11132024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11142024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11152024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11162024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11172024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11182024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11192024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11202024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11212024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11222024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11232024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11242024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11252024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11262024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11272024-12-18T22:15:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11282024-12-18T22:15:43.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-12-18T22:15:43.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-12-18T22:15:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11312024-12-18T22:15:43.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11322024-12-18T22:15:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11332024-12-18T22:15:43.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.170992ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11342024-12-18T22:15:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11352024-12-18T22:15:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11362024-12-18T22:15:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11372024-12-18T22:15:43.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11382024-12-18T22:15:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.075618ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
11392024-12-18T22:15:43.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 425800624 } })
11402024-12-18T22:15:43.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11412024-12-18T22:15:43.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11422024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11432024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11442024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11452024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11462024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11472024-12-18T22:15:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11482024-12-18T22:15:43.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11492024-12-18T22:15:43.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-12-18T22:15:43.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 430109138 } })
11512024-12-18T22:15:43.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 430307992 } })
11522024-12-18T22:15:43.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11532024-12-18T22:15:43.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
11542024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11552024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11562024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11572024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11582024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11592024-12-18T22:15:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11602024-12-18T22:15:43.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11612024-12-18T22:15:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11622024-12-18T22:15:43.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11632024-12-18T22:15:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11642024-12-18T22:15:43.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652024-12-18T22:15:43.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11662024-12-18T22:15:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11672024-12-18T22:15:43.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11682024-12-18T22:15:43.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11692024-12-18T22:15:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11702024-12-18T22:15:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712024-12-18T22:15:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11722024-12-18T22:15:43.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11732024-12-18T22:15:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11742024-12-18T22:15:43.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11752024-12-18T22:15:43.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11762024-12-18T22:15:43.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.218789ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
11772024-12-18T22:15:43.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11782024-12-18T22:15:43.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11792024-12-18T22:15:43.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-12-18T22:15:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11812024-12-18T22:15:43.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11822024-12-18T22:15:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11832024-12-18T22:15:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11842024-12-18T22:15:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11852024-12-18T22:15:43.843ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11862024-12-18T22:15:43.843ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11872024-12-18T22:15:43.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11882024-12-18T22:15:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11892024-12-18T22:15:43.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11902024-12-18T22:15:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11912024-12-18T22:15:43.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11922024-12-18T22:15:43.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.494969ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11932024-12-18T22:15:43.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11942024-12-18T22:15:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
11952024-12-18T22:15:43.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11962024-12-18T22:15:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11972024-12-18T22:15:43.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.676794ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11982024-12-18T22:15:43.871ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 79.627392ms iteration = 6 status = {"physical_disks_added":0}
11992024-12-18T22:15:43.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12002024-12-18T22:15:43.906ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12012024-12-18T22:15:43.906ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ece739-8a8c-47b6-bdb9-1cf3e03f4ec9", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12022024-12-18T22:15:43.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12032024-12-18T22:15:43.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12042024-12-18T22:15:43.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12052024-12-18T22:15:43.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12062024-12-18T22:15:43.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
12072024-12-18T22:15:43.917ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12082024-12-18T22:15:43.917ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdd8e0cb-a157-4b18-a17c-da001102e2df", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12092024-12-18T22:15:43.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12102024-12-18T22:15:43.918ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
12112024-12-18T22:15:43.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12122024-12-18T22:15:43.919ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12132024-12-18T22:15:43.919ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68b9f946-bf4f-4e18-a1cb-27ab77bc2892", "content-length": "26", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12142024-12-18T22:15:43.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12152024-12-18T22:15:43.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12162024-12-18T22:15:43.927ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12172024-12-18T22:15:43.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12182024-12-18T22:15:43.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2440d382-19bc-4d76-9cec-8cbda021ac11", "content-length": "372", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12192024-12-18T22:15:43.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12202024-12-18T22:15:43.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12212024-12-18T22:15:43.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12222024-12-18T22:15:43.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12232024-12-18T22:15:43.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12242024-12-18T22:15:43.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12252024-12-18T22:15:43.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 169.052087ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12262024-12-18T22:15:43.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 171.328091ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12272024-12-18T22:15:43.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12282024-12-18T22:15:43.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12292024-12-18T22:15:43.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.062185ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12302024-12-18T22:15:43.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-12-18T22:15:43.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12322024-12-18T22:15:43.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12332024-12-18T22:15:43.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12342024-12-18T22:15:43.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352024-12-18T22:15:43.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12362024-12-18T22:15:43.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12372024-12-18T22:15:43.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12382024-12-18T22:15:43.979ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12392024-12-18T22:15:43.979ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12402024-12-18T22:15:43.979ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f761a375-ce2d-485c-a81d-6a8c1582c5a4", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12412024-12-18T22:15:43.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12422024-12-18T22:15:43.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12432024-12-18T22:15:43.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12442024-12-18T22:15:43.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12452024-12-18T22:15:43.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12462024-12-18T22:15:43.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12472024-12-18T22:15:43.988ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12482024-12-18T22:15:43.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12492024-12-18T22:15:43.988ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8cf43cfc-dcb4-4e1e-99a2-c7ec1a935d07", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12502024-12-18T22:15:43.989ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 198.499485ms iteration = 4 status = {}
12512024-12-18T22:15:43.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 202.905321ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12522024-12-18T22:15:44.013ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12532024-12-18T22:15:44.014ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fcf8be5-d966-41b6-b6f7-bb21027acc4d", "content-length": "1", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12542024-12-18T22:15:44.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12552024-12-18T22:15:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12562024-12-18T22:15:44.020ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.893471ms iteration = 4 status = null
12572024-12-18T22:15:44.062ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
12582024-12-18T22:15:44.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 270.881665ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
12592024-12-18T22:15:44.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12602024-12-18T22:15:44.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12612024-12-18T22:15:44.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12622024-12-18T22:15:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12632024-12-18T22:15:44.076ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 284.973082ms iteration = 4 status = {}
12642024-12-18T22:15:44.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12652024-12-18T22:15:44.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
12662024-12-18T22:15:44.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12672024-12-18T22:15:44.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12682024-12-18T22:15:44.113ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12692024-12-18T22:15:44.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b6a9029-7c11-4df0-8c2b-ddc20a366736", "content-length": "691", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12702024-12-18T22:15:44.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12712024-12-18T22:15:44.114ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12722024-12-18T22:15:44.114ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12732024-12-18T22:15:44.115ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.083148ms iteration = 4 status = {}
12742024-12-18T22:15:44.116ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 325.128469ms iteration = 4 status = 0
12752024-12-18T22:15:44.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daf9343-22ad-4f4f-8e4b-08d82fe3b905 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
12762024-12-18T22:15:44.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daf9343-22ad-4f4f-8e4b-08d82fe3b905 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
12772024-12-18T22:15:44.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daf9343-22ad-4f4f-8e4b-08d82fe3b905 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
12782024-12-18T22:15:44.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12792024-12-18T22:15:44.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12802024-12-18T22:15:44.166ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
12812024-12-18T22:15:44.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12822024-12-18T22:15:44.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12832024-12-18T22:15:44.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12842024-12-18T22:15:44.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8167177-3c0a-40a1-839b-cf75b1cb876e", "content-length": "134", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
12852024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12862024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
12872024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12882024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12892024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12902024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12912024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12922024-12-18T22:15:44.175ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12932024-12-18T22:15:44.176ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12942024-12-18T22:15:44.176ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12952024-12-18T22:15:44.176ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
12962024-12-18T22:15:44.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12972024-12-18T22:15:44.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12982024-12-18T22:15:44.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12992024-12-18T22:15:44.187ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1cf03c9-32ca-4190-a070-540b1cd54183", "content-length": "2", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
13002024-12-18T22:15:44.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13012024-12-18T22:15:44.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "956faffd-0c1b-40d5-b659-01b2f40dbde4", "content-length": "52", "date": "Wed, 18 Dec 2024 22:15:43 GMT"} })
13022024-12-18T22:15:44.188ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
13032024-12-18T22:15:44.188ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13042024-12-18T22:15:44.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "097c4348-163b-48f0-993e-4be5e97cf29b", "date": "Wed, 18 Dec 2024 22:15:44 GMT"} })
13052024-12-18T22:15:44.276ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
13062024-12-18T22:15:44.276ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13072024-12-18T22:15:44.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c478c68-cbd3-46cc-9c14-d6ab370cd0bb", "content-length": "682", "date": "Wed, 18 Dec 2024 22:15:44 GMT"} })
13082024-12-18T22:15:44.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13092024-12-18T22:15:44.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13102024-12-18T22:15:44.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13112024-12-18T22:15:44.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13122024-12-18T22:15:44.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13132024-12-18T22:15:44.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13142024-12-18T22:15:44.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13152024-12-18T22:15:44.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13162024-12-18T22:15:44.301ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 510.1868ms iteration = 4 status = {}
13172024-12-18T22:15:45.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daae0a6-4a41-4fe2-bf7c-0bc5b67cdd76 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13182024-12-18T22:15:45.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daae0a6-4a41-4fe2-bf7c-0bc5b67cdd76 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13192024-12-18T22:15:45.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6daae0a6-4a41-4fe2-bf7c-0bc5b67cdd76 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13202024-12-18T22:15:46.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 116a25ac-5ebf-4f16-9865-9f394b2cdb38 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13212024-12-18T22:15:46.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 116a25ac-5ebf-4f16-9865-9f394b2cdb38 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13222024-12-18T22:15:46.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 116a25ac-5ebf-4f16-9865-9f394b2cdb38 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13232024-12-18T22:15:46.628ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 8aaef686-d3e6-4cb7-8029-4e19f5025844 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
13242024-12-18T22:15:47.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d0067bda-8550-425c-b942-04c2c1125e17 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13252024-12-18T22:15:47.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d0067bda-8550-425c-b942-04c2c1125e17 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13262024-12-18T22:15:47.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d0067bda-8550-425c-b942-04c2c1125e17 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13272024-12-18T22:15:48.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 002b1ba8-04e3-4118-bafb-aae86fc83935 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13282024-12-18T22:15:48.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 002b1ba8-04e3-4118-bafb-aae86fc83935 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13292024-12-18T22:15:48.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 002b1ba8-04e3-4118-bafb-aae86fc83935 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13302024-12-18T22:15:49.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2496d91e-d520-4a88-8ad6-694cf778aca4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13312024-12-18T22:15:49.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2496d91e-d520-4a88-8ad6-694cf778aca4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13322024-12-18T22:15:49.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2496d91e-d520-4a88-8ad6-694cf778aca4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13332024-12-18T22:15:50.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b04c89c-9a10-4f67-a91a-6ae2c4d24a2b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13342024-12-18T22:15:50.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b04c89c-9a10-4f67-a91a-6ae2c4d24a2b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13352024-12-18T22:15:50.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b04c89c-9a10-4f67-a91a-6ae2c4d24a2b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13362024-12-18T22:15:51.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d3f6d0-db5b-4b48-92a8-28613b625b67 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13372024-12-18T22:15:51.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d3f6d0-db5b-4b48-92a8-28613b625b67 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13382024-12-18T22:15:51.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d3f6d0-db5b-4b48-92a8-28613b625b67 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13392024-12-18T22:15:52.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf1db46-f31d-46ce-b59c-e832f3594f08 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13402024-12-18T22:15:52.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf1db46-f31d-46ce-b59c-e832f3594f08 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13412024-12-18T22:15:52.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf1db46-f31d-46ce-b59c-e832f3594f08 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13422024-12-18T22:15:53.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 878991f4-22dd-4863-b612-1c4408337e0b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13432024-12-18T22:15:53.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 878991f4-22dd-4863-b612-1c4408337e0b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13442024-12-18T22:15:53.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 878991f4-22dd-4863-b612-1c4408337e0b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13452024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
13462024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13472024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
13482024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13492024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13502024-12-18T22:15:53.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13512024-12-18T22:15:53.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13522024-12-18T22:15:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13532024-12-18T22:15:53.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542024-12-18T22:15:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552024-12-18T22:15:53.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13562024-12-18T22:15:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13572024-12-18T22:15:53.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13582024-12-18T22:15:53.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13592024-12-18T22:15:53.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13602024-12-18T22:15:53.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
13612024-12-18T22:15:53.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13622024-12-18T22:15:53.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13632024-12-18T22:15:53.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
13642024-12-18T22:15:53.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.793047ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
13652024-12-18T22:15:53.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.750052ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13662024-12-18T22:15:54.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2fbc67ed-761a-4fa7-9ac5-53c5bb7e42c7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13672024-12-18T22:15:54.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2fbc67ed-761a-4fa7-9ac5-53c5bb7e42c7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13682024-12-18T22:15:54.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2fbc67ed-761a-4fa7-9ac5-53c5bb7e42c7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13692024-12-18T22:15:55.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dbe1376c-3b0a-459e-8532-bd87ec9fd5d6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13702024-12-18T22:15:55.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dbe1376c-3b0a-459e-8532-bd87ec9fd5d6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13712024-12-18T22:15:55.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dbe1376c-3b0a-459e-8532-bd87ec9fd5d6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13722024-12-18T22:15:56.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a0dec7b-e1b5-4bd5-b9e3-f2ae239a4307 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13732024-12-18T22:15:56.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a0dec7b-e1b5-4bd5-b9e3-f2ae239a4307 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13742024-12-18T22:15:56.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a0dec7b-e1b5-4bd5-b9e3-f2ae239a4307 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13752024-12-18T22:15:56.628ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 3ea4537d-31f6-4809-a3be-a996c5e8a2f1 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
13762024-12-18T22:15:57.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c55bdda2-7b95-4800-bf6f-90837c821766 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13772024-12-18T22:15:57.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c55bdda2-7b95-4800-bf6f-90837c821766 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13782024-12-18T22:15:57.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c55bdda2-7b95-4800-bf6f-90837c821766 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13792024-12-18T22:15:58.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35b7e87b-b846-43bd-b755-342d19cfe661 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13802024-12-18T22:15:58.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35b7e87b-b846-43bd-b755-342d19cfe661 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13812024-12-18T22:15:58.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35b7e87b-b846-43bd-b755-342d19cfe661 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13822024-12-18T22:15:59.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e896cbe7-9804-4a13-abc5-6f18b21a2a8b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13832024-12-18T22:15:59.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e896cbe7-9804-4a13-abc5-6f18b21a2a8b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13842024-12-18T22:15:59.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e896cbe7-9804-4a13-abc5-6f18b21a2a8b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13852024-12-18T22:16:00.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9631b88b-9ab4-4cda-a002-22812584ee91 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13862024-12-18T22:16:00.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9631b88b-9ab4-4cda-a002-22812584ee91 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13872024-12-18T22:16:00.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9631b88b-9ab4-4cda-a002-22812584ee91 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13882024-12-18T22:16:01.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07639298-45d5-44fe-b165-fea1ef9e2808 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13892024-12-18T22:16:01.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07639298-45d5-44fe-b165-fea1ef9e2808 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13902024-12-18T22:16:01.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07639298-45d5-44fe-b165-fea1ef9e2808 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13912024-12-18T22:16:02.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ad259e35-55bc-4dbb-a885-b0de0e019b03 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13922024-12-18T22:16:02.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ad259e35-55bc-4dbb-a885-b0de0e019b03 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13932024-12-18T22:16:02.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ad259e35-55bc-4dbb-a885-b0de0e019b03 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13942024-12-18T22:16:03.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55bc25e9-d16a-4db8-829e-c8ae73c8acd2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13952024-12-18T22:16:03.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55bc25e9-d16a-4db8-829e-c8ae73c8acd2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13962024-12-18T22:16:03.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55bc25e9-d16a-4db8-829e-c8ae73c8acd2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
13972024-12-18T22:16:03.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
13982024-12-18T22:16:03.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13992024-12-18T22:16:03.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
14002024-12-18T22:16:03.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14012024-12-18T22:16:03.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14022024-12-18T22:16:03.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14032024-12-18T22:16:03.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14042024-12-18T22:16:03.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14052024-12-18T22:16:03.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14062024-12-18T22:16:03.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14072024-12-18T22:16:03.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14082024-12-18T22:16:03.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14092024-12-18T22:16:03.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14102024-12-18T22:16:03.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14112024-12-18T22:16:03.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122024-12-18T22:16:03.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
14132024-12-18T22:16:03.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14142024-12-18T22:16:03.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14152024-12-18T22:16:03.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
14162024-12-18T22:16:03.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.833938ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
14172024-12-18T22:16:03.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.230813ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14182024-12-18T22:16:04.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5000b251-b7fd-4c6a-b6d0-393fd6def295 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14192024-12-18T22:16:04.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5000b251-b7fd-4c6a-b6d0-393fd6def295 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14202024-12-18T22:16:04.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5000b251-b7fd-4c6a-b6d0-393fd6def295 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14212024-12-18T22:16:05.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8cd7fbc5-161c-4cb2-848c-c87167c8978b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14222024-12-18T22:16:05.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8cd7fbc5-161c-4cb2-848c-c87167c8978b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14232024-12-18T22:16:05.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8cd7fbc5-161c-4cb2-848c-c87167c8978b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14242024-12-18T22:16:06.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114e1412-3997-4f6e-984a-394f926a1ea2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14252024-12-18T22:16:06.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114e1412-3997-4f6e-984a-394f926a1ea2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14262024-12-18T22:16:06.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114e1412-3997-4f6e-984a-394f926a1ea2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14272024-12-18T22:16:06.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 2b127438-5521-43c0-a207-6a8c8e5461d9 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
14282024-12-18T22:16:07.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7895a681-82c8-43de-91e2-d1afb483166a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14292024-12-18T22:16:07.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7895a681-82c8-43de-91e2-d1afb483166a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14302024-12-18T22:16:07.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7895a681-82c8-43de-91e2-d1afb483166a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14312024-12-18T22:16:08.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b93cd99f-7648-400f-a5d5-b73bcc903a42 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14322024-12-18T22:16:08.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b93cd99f-7648-400f-a5d5-b73bcc903a42 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14332024-12-18T22:16:08.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b93cd99f-7648-400f-a5d5-b73bcc903a42 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14342024-12-18T22:16:09.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e9fb9c6-215b-4db6-a02f-62ef223dd1de roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14352024-12-18T22:16:09.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e9fb9c6-215b-4db6-a02f-62ef223dd1de resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14362024-12-18T22:16:09.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e9fb9c6-215b-4db6-a02f-62ef223dd1de response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14372024-12-18T22:16:10.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a2811e5-05ef-485b-99b6-fbf57395bf15 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14382024-12-18T22:16:10.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a2811e5-05ef-485b-99b6-fbf57395bf15 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14392024-12-18T22:16:10.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a2811e5-05ef-485b-99b6-fbf57395bf15 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14402024-12-18T22:16:11.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = b166f056-485f-4f8c-a8fa-9c74b13a9191 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
14412024-12-18T22:16:11.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = b166f056-485f-4f8c-a8fa-9c74b13a9191 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
14422024-12-18T22:16:11.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = b166f056-485f-4f8c-a8fa-9c74b13a9191 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
14432024-12-18T22:16:11.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0056a111-090f-454d-94e4-8e0787672c61 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
14442024-12-18T22:16:11.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0056a111-090f-454d-94e4-8e0787672c61 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
14452024-12-18T22:16:11.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0056a111-090f-454d-94e4-8e0787672c61 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
14462024-12-18T22:16:11.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07826069-0e68-4746-abc8-45484b9e6443 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14472024-12-18T22:16:11.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07826069-0e68-4746-abc8-45484b9e6443 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14482024-12-18T22:16:11.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07826069-0e68-4746-abc8-45484b9e6443 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14492024-12-18T22:16:12.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 253de77c-ea72-4430-ad07-e39a3c2c6c3e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14502024-12-18T22:16:12.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 253de77c-ea72-4430-ad07-e39a3c2c6c3e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14512024-12-18T22:16:12.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 253de77c-ea72-4430-ad07-e39a3c2c6c3e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
14522024-12-18T22:16:13.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b8ff15da-f987-4f78-b4da-98c1cc0aa7ba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14532024-12-18T22:16:13.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b8ff15da-f987-4f78-b4da-98c1cc0aa7ba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14542024-12-18T22:16:13.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b8ff15da-f987-4f78-b4da-98c1cc0aa7ba response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14552024-12-18T22:16:13.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
14562024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
14572024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
14582024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14592024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14602024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
14612024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
14622024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
14632024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14642024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
14652024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
14662024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14672024-12-18T22:16:13.791ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:06:13.791061357 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14682024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
14692024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14702024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14712024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14722024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
14732024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14742024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
14752024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
14762024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14772024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14782024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
14792024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
14802024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14812024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14822024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
14832024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14842024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
14852024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
14862024-12-18T22:16:13.791ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14872024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14882024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14892024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
14902024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14912024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
14922024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
14932024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14942024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
14952024-12-18T22:16:13.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14962024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14972024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14982024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
14992024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15002024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
15012024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15022024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
15032024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15042024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15052024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
15062024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15072024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
15082024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15092024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
15102024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15112024-12-18T22:16:13.791ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
15122024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.68\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
15132024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
15142024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15152024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
15162024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
15172024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15182024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15192024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15202024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15212024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15222024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15232024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15242024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15252024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15262024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15272024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15282024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15292024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15302024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15312024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15322024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15332024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15342024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15352024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15362024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15372024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15382024-12-18T22:16:13.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 416212246 } })
15392024-12-18T22:16:13.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15402024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15412024-12-18T22:16:13.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 416219596 } })
15422024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15432024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15442024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.364767ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15452024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
15462024-12-18T22:16:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.53903ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15472024-12-18T22:16:13.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ddcfef7-aad9-4305-811b-b4e6523740a4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
15482024-12-18T22:16:13.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ddcfef7-aad9-4305-811b-b4e6523740a4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
15492024-12-18T22:16:13.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15502024-12-18T22:16:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15512024-12-18T22:16:13.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15522024-12-18T22:16:13.795ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:06:13.791061357 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15532024-12-18T22:16:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.869656ms iteration = 3 status = {"expiration":"2024-12-18T22:06:13.791061357Z","pruned":[]}
15542024-12-18T22:16:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15552024-12-18T22:16:13.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15562024-12-18T22:16:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15572024-12-18T22:16:13.797ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 421480149 } })
15582024-12-18T22:16:13.797ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15592024-12-18T22:16:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.11566ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15602024-12-18T22:16:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.682ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
15612024-12-18T22:16:13.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-12-18T22:16:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15632024-12-18T22:16:13.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15642024-12-18T22:16:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15652024-12-18T22:16:13.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15662024-12-18T22:16:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15672024-12-18T22:16:13.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 429793152 } })
15682024-12-18T22:16:13.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15692024-12-18T22:16:13.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ddcfef7-aad9-4305-811b-b4e6523740a4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
15702024-12-18T22:16:13.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15712024-12-18T22:16:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15722024-12-18T22:16:13.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15732024-12-18T22:16:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15742024-12-18T22:16:13.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15752024-12-18T22:16:13.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.936489ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
15762024-12-18T22:16:13.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15772024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15782024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15792024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15802024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15812024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15822024-12-18T22:16:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15832024-12-18T22:16:13.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15842024-12-18T22:16:13.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-12-18T22:16:13.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15862024-12-18T22:16:13.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872024-12-18T22:16:13.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15882024-12-18T22:16:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15892024-12-18T22:16:13.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-12-18T22:16:13.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15912024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15922024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15932024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15942024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.200481ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
15952024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15962024-12-18T22:16:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15972024-12-18T22:16:13.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15982024-12-18T22:16:13.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15992024-12-18T22:16:13.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16002024-12-18T22:16:13.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-12-18T22:16:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16022024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16032024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16042024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16052024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16062024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16072024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16082024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16092024-12-18T22:16:13.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16102024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16112024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16122024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16132024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16142024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16152024-12-18T22:16:13.854ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16162024-12-18T22:16:13.854ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.607098ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
16172024-12-18T22:16:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
16182024-12-18T22:16:13.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16192024-12-18T22:16:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16202024-12-18T22:16:13.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 480927995 } })
16212024-12-18T22:16:13.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
16222024-12-18T22:16:13.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232024-12-18T22:16:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16242024-12-18T22:16:13.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16252024-12-18T22:16:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16262024-12-18T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16272024-12-18T22:16:13.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16282024-12-18T22:16:13.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16292024-12-18T22:16:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16302024-12-18T22:16:13.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16312024-12-18T22:16:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16322024-12-18T22:16:13.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.875371ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16332024-12-18T22:16:13.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16342024-12-18T22:16:13.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16352024-12-18T22:16:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16362024-12-18T22:16:13.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16372024-12-18T22:16:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16382024-12-18T22:16:13.885ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16392024-12-18T22:16:13.885ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16402024-12-18T22:16:13.885ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16412024-12-18T22:16:13.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16422024-12-18T22:16:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16432024-12-18T22:16:13.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442024-12-18T22:16:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16452024-12-18T22:16:13.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16462024-12-18T22:16:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16472024-12-18T22:16:13.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16482024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16492024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16502024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16512024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16522024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16532024-12-18T22:16:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16542024-12-18T22:16:13.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552024-12-18T22:16:13.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.56737ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16562024-12-18T22:16:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
16572024-12-18T22:16:13.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16582024-12-18T22:16:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16592024-12-18T22:16:13.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16602024-12-18T22:16:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16612024-12-18T22:16:13.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.399363ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16622024-12-18T22:16:13.912ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16632024-12-18T22:16:13.912ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16642024-12-18T22:16:13.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16652024-12-18T22:16:13.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16662024-12-18T22:16:13.913ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16672024-12-18T22:16:13.913ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16682024-12-18T22:16:13.913ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.257159ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16692024-12-18T22:16:13.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16702024-12-18T22:16:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16712024-12-18T22:16:13.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16722024-12-18T22:16:13.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
16732024-12-18T22:16:13.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.236816ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
16742024-12-18T22:16:13.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16752024-12-18T22:16:13.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.132895ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16762024-12-18T22:16:13.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16772024-12-18T22:16:13.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16782024-12-18T22:16:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16792024-12-18T22:16:13.930ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16802024-12-18T22:16:13.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16812024-12-18T22:16:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16822024-12-18T22:16:13.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832024-12-18T22:16:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16842024-12-18T22:16:13.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16852024-12-18T22:16:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16862024-12-18T22:16:13.948ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16872024-12-18T22:16:13.948ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
16882024-12-18T22:16:13.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16892024-12-18T22:16:13.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16902024-12-18T22:16:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 160.603991ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16912024-12-18T22:16:13.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16922024-12-18T22:16:13.960ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16932024-12-18T22:16:13.960ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b913b8e6-b927-4dbc-ad45-290da0fb19c1", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
16942024-12-18T22:16:13.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16952024-12-18T22:16:13.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16962024-12-18T22:16:13.965ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16972024-12-18T22:16:13.965ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16982024-12-18T22:16:13.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.567895ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16992024-12-18T22:16:13.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17002024-12-18T22:16:13.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012024-12-18T22:16:13.985ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17022024-12-18T22:16:13.985ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17032024-12-18T22:16:13.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17042024-12-18T22:16:13.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17052024-12-18T22:16:13.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17062024-12-18T22:16:13.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17072024-12-18T22:16:13.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17082024-12-18T22:16:13.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17092024-12-18T22:16:13.989ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 198.977124ms iteration = 7 status = {"physical_disks_added":0}
17102024-12-18T22:16:13.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17112024-12-18T22:16:13.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17122024-12-18T22:16:13.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17132024-12-18T22:16:13.990ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17142024-12-18T22:16:13.990ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17152024-12-18T22:16:13.990ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4132f34b-1f49-402e-bf34-2cf18bc20290", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
17162024-12-18T22:16:13.990ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17172024-12-18T22:16:13.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17182024-12-18T22:16:13.998ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17192024-12-18T22:16:13.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 206.843278ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17202024-12-18T22:16:14.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17212024-12-18T22:16:14.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17222024-12-18T22:16:14.070ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
17232024-12-18T22:16:14.070ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 279.3055ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17242024-12-18T22:16:14.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17252024-12-18T22:16:14.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17262024-12-18T22:16:14.092ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
17272024-12-18T22:16:14.092ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17282024-12-18T22:16:14.092ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
17292024-12-18T22:16:14.092ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 301.084368ms iteration = 3 status = {"generation":2}
17302024-12-18T22:16:14.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17312024-12-18T22:16:14.108ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "feb1c08f-4a27-483a-a368-798995153c3c", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17322024-12-18T22:16:14.108ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17332024-12-18T22:16:14.109ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "aa4d2209-c137-40a4-9347-2414cebdb9a6", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17342024-12-18T22:16:14.109ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17352024-12-18T22:16:14.111ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17362024-12-18T22:16:14.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 320.223803ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17372024-12-18T22:16:14.130ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.284977ms iteration = 5 status = {}
17382024-12-18T22:16:14.146ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17392024-12-18T22:16:14.146ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2605f3b5-bb85-4145-8e22-f4098eed18c0", "content-length": "1", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
17402024-12-18T22:16:14.147ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17412024-12-18T22:16:14.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17422024-12-18T22:16:14.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
17432024-12-18T22:16:14.193ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17442024-12-18T22:16:14.194ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a2f1cb-0479-475f-a752-a81f6e3c5405", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
17452024-12-18T22:16:14.194ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17462024-12-18T22:16:14.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
17472024-12-18T22:16:14.249ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17482024-12-18T22:16:14.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17492024-12-18T22:16:14.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb04b5d-91f3-44e9-98f1-c4353d7b6d7b", "content-length": "372", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
17502024-12-18T22:16:14.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17512024-12-18T22:16:14.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17522024-12-18T22:16:14.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-12-18T22:16:14.252ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17542024-12-18T22:16:14.252ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17552024-12-18T22:16:14.252ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
17562024-12-18T22:16:14.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 460.996585ms iteration = 3 status = {"generation":1}
17572024-12-18T22:16:14.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.498515ms iteration = 5 status = null
17582024-12-18T22:16:14.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17592024-12-18T22:16:14.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17602024-12-18T22:16:14.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17612024-12-18T22:16:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17622024-12-18T22:16:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17632024-12-18T22:16:14.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-12-18T22:16:14.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-12-18T22:16:14.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17662024-12-18T22:16:14.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17672024-12-18T22:16:14.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17682024-12-18T22:16:14.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
17692024-12-18T22:16:14.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17702024-12-18T22:16:14.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17712024-12-18T22:16:14.259ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 468.085034ms iteration = 5 status = 0
17722024-12-18T22:16:14.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17732024-12-18T22:16:14.289ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17742024-12-18T22:16:14.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17752024-12-18T22:16:14.289ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a1b8870a-41b1-4680-b4fb-14fcabc08b50", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
17762024-12-18T22:16:14.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17772024-12-18T22:16:14.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17782024-12-18T22:16:14.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17792024-12-18T22:16:14.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17802024-12-18T22:16:14.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17812024-12-18T22:16:14.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17822024-12-18T22:16:14.297ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17832024-12-18T22:16:14.297ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17842024-12-18T22:16:14.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "208c4fbc-a8ce-40cc-9883-e6ed3a0dc517", "date": "Wed, 18 Dec 2024 22:16:13 GMT"} })
17852024-12-18T22:16:14.299ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 508.383365ms iteration = 5 status = {}
17862024-12-18T22:16:14.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17872024-12-18T22:16:14.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "aff73591-193b-4d8d-aa26-ce33f3840f3a", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17882024-12-18T22:16:14.364ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17892024-12-18T22:16:14.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "99bfb52b-783b-4af8-af08-f73e2e387b3e", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17902024-12-18T22:16:14.366ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17912024-12-18T22:16:14.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "803ac5f7-abb9-4c55-84ed-0a537ca6ae61", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17922024-12-18T22:16:14.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17932024-12-18T22:16:14.369ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17942024-12-18T22:16:14.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 578.902608ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17952024-12-18T22:16:14.392ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17962024-12-18T22:16:14.392ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "02825f0c-395c-4370-96b0-535723b63820", "content-length": "691", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
17972024-12-18T22:16:14.392ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17982024-12-18T22:16:14.392ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17992024-12-18T22:16:14.392ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18002024-12-18T22:16:14.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18012024-12-18T22:16:14.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18022024-12-18T22:16:14.393ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 602.556162ms iteration = 5 status = {}
18032024-12-18T22:16:14.395ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
18042024-12-18T22:16:14.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18052024-12-18T22:16:14.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18062024-12-18T22:16:14.405ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18072024-12-18T22:16:14.405ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "20fef6d9-d020-4279-9ee0-d3327fb85eb5", "content-length": "134", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
18082024-12-18T22:16:14.405ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18092024-12-18T22:16:14.405ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
18102024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18112024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18122024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18132024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18142024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18152024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18162024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18172024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18182024-12-18T22:16:14.406ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
18192024-12-18T22:16:14.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18202024-12-18T22:16:14.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18212024-12-18T22:16:14.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18222024-12-18T22:16:14.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e7e23d4-e8b9-48dc-b1e6-0e5d7f42e072", "content-length": "2", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
18232024-12-18T22:16:14.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18242024-12-18T22:16:14.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be408a5-e963-412a-9d1d-e3cb1c3b9e97", "content-length": "52", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
18252024-12-18T22:16:14.409ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
18262024-12-18T22:16:14.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18272024-12-18T22:16:14.499ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cf04d8b4-e98b-4c22-b334-e8350f33c5fe", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
18282024-12-18T22:16:14.499ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
18292024-12-18T22:16:14.499ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18302024-12-18T22:16:14.500ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "52b162cb-b2be-4a2e-b09a-4c1dabb0c1f3", "content-length": "682", "date": "Wed, 18 Dec 2024 22:16:14 GMT"} })
18312024-12-18T22:16:14.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18322024-12-18T22:16:14.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18332024-12-18T22:16:14.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18342024-12-18T22:16:14.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18352024-12-18T22:16:14.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18362024-12-18T22:16:14.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18372024-12-18T22:16:14.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18382024-12-18T22:16:14.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18392024-12-18T22:16:14.528ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 737.886958ms iteration = 5 status = {}
18402024-12-18T22:16:14.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b475b8b-79cb-4693-95bc-9c6958b71eb5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18412024-12-18T22:16:14.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b475b8b-79cb-4693-95bc-9c6958b71eb5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18422024-12-18T22:16:14.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b475b8b-79cb-4693-95bc-9c6958b71eb5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18432024-12-18T22:16:15.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 67137dc5-250e-4ab4-974d-3cb63e51ab27 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18442024-12-18T22:16:15.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 67137dc5-250e-4ab4-974d-3cb63e51ab27 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18452024-12-18T22:16:15.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 67137dc5-250e-4ab4-974d-3cb63e51ab27 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18462024-12-18T22:16:16.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5d5ed85d-7460-428b-a411-ea24f7e6d5fd response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18472024-12-18T22:16:16.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b9cb352-6bf2-4cf5-b5c3-c4c256f8199a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18482024-12-18T22:16:16.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b9cb352-6bf2-4cf5-b5c3-c4c256f8199a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18492024-12-18T22:16:16.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b9cb352-6bf2-4cf5-b5c3-c4c256f8199a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18502024-12-18T22:16:17.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9d8218a-b6a9-43df-a273-1c5fb6e89436 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18512024-12-18T22:16:17.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9d8218a-b6a9-43df-a273-1c5fb6e89436 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18522024-12-18T22:16:17.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9d8218a-b6a9-43df-a273-1c5fb6e89436 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18532024-12-18T22:16:18.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c806b1a-00f6-487b-b879-4c20b368a8d0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18542024-12-18T22:16:18.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c806b1a-00f6-487b-b879-4c20b368a8d0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18552024-12-18T22:16:18.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c806b1a-00f6-487b-b879-4c20b368a8d0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18562024-12-18T22:16:19.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f2e2aad-6fa2-4952-a4a7-78a72b44b084 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18572024-12-18T22:16:19.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f2e2aad-6fa2-4952-a4a7-78a72b44b084 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18582024-12-18T22:16:19.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f2e2aad-6fa2-4952-a4a7-78a72b44b084 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18592024-12-18T22:16:20.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcd7d14b-57ba-4c98-9d64-7c82b23074ce roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18602024-12-18T22:16:20.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcd7d14b-57ba-4c98-9d64-7c82b23074ce resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18612024-12-18T22:16:20.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcd7d14b-57ba-4c98-9d64-7c82b23074ce response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18622024-12-18T22:16:21.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe163068-b274-4491-bb20-d6b48304b982 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18632024-12-18T22:16:21.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe163068-b274-4491-bb20-d6b48304b982 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18642024-12-18T22:16:21.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe163068-b274-4491-bb20-d6b48304b982 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18652024-12-18T22:16:23.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e922705-67ca-4d01-8013-f91c33be963e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18662024-12-18T22:16:23.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e922705-67ca-4d01-8013-f91c33be963e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18672024-12-18T22:16:23.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e922705-67ca-4d01-8013-f91c33be963e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18682024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
18692024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18702024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
18712024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18722024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18732024-12-18T22:16:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18742024-12-18T22:16:23.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752024-12-18T22:16:23.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18762024-12-18T22:16:23.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18772024-12-18T22:16:23.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18782024-12-18T22:16:23.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18792024-12-18T22:16:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18802024-12-18T22:16:23.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-12-18T22:16:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
18822024-12-18T22:16:23.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18832024-12-18T22:16:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18842024-12-18T22:16:23.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
18852024-12-18T22:16:23.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.717546ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
18862024-12-18T22:16:23.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18872024-12-18T22:16:23.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18882024-12-18T22:16:23.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.410714ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18892024-12-18T22:16:24.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 38c081e7-36e9-4cca-a0a9-c012ed694bd0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18902024-12-18T22:16:24.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 38c081e7-36e9-4cca-a0a9-c012ed694bd0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18912024-12-18T22:16:24.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 38c081e7-36e9-4cca-a0a9-c012ed694bd0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18922024-12-18T22:16:25.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b386456b-62a4-45a2-8fc7-c549c274012d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18932024-12-18T22:16:25.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b386456b-62a4-45a2-8fc7-c549c274012d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18942024-12-18T22:16:25.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b386456b-62a4-45a2-8fc7-c549c274012d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18952024-12-18T22:16:26.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5669b27c-8cba-41ab-ad4d-8667de0e9fec roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18962024-12-18T22:16:26.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5669b27c-8cba-41ab-ad4d-8667de0e9fec resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18972024-12-18T22:16:26.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5669b27c-8cba-41ab-ad4d-8667de0e9fec response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
18982024-12-18T22:16:26.628ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 8dd3ecdb-d9a6-4e60-9c3a-5c6d319bac87 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
18992024-12-18T22:16:27.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c2337e1-eb41-420a-9421-602f24302048 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19002024-12-18T22:16:27.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c2337e1-eb41-420a-9421-602f24302048 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19012024-12-18T22:16:27.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c2337e1-eb41-420a-9421-602f24302048 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19022024-12-18T22:16:28.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b320762-e507-4a33-a4e0-cfd1d715ba56 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19032024-12-18T22:16:28.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b320762-e507-4a33-a4e0-cfd1d715ba56 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19042024-12-18T22:16:28.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b320762-e507-4a33-a4e0-cfd1d715ba56 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19052024-12-18T22:16:29.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 761bf94e-a046-407a-b3c6-96fd8b31af88 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19062024-12-18T22:16:29.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 761bf94e-a046-407a-b3c6-96fd8b31af88 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19072024-12-18T22:16:29.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 761bf94e-a046-407a-b3c6-96fd8b31af88 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19082024-12-18T22:16:30.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff81ec70-e6e5-4e61-bc5e-3e585e7f16e7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19092024-12-18T22:16:30.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff81ec70-e6e5-4e61-bc5e-3e585e7f16e7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19102024-12-18T22:16:30.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff81ec70-e6e5-4e61-bc5e-3e585e7f16e7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19112024-12-18T22:16:31.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56b33973-acb4-4ef8-95ae-95fc68330f15 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19122024-12-18T22:16:31.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56b33973-acb4-4ef8-95ae-95fc68330f15 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19132024-12-18T22:16:31.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56b33973-acb4-4ef8-95ae-95fc68330f15 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19142024-12-18T22:16:32.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be31114d-a724-454c-8bf7-25bbc0b00d46 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19152024-12-18T22:16:32.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be31114d-a724-454c-8bf7-25bbc0b00d46 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19162024-12-18T22:16:32.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be31114d-a724-454c-8bf7-25bbc0b00d46 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19172024-12-18T22:16:33.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7d51dee8-8cdc-47ef-b89e-139f019cff67 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19182024-12-18T22:16:33.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7d51dee8-8cdc-47ef-b89e-139f019cff67 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19192024-12-18T22:16:33.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7d51dee8-8cdc-47ef-b89e-139f019cff67 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19202024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
19212024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
19222024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19232024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19242024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19252024-12-18T22:16:33.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19262024-12-18T22:16:33.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19272024-12-18T22:16:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19282024-12-18T22:16:33.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19292024-12-18T22:16:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19302024-12-18T22:16:33.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312024-12-18T22:16:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322024-12-18T22:16:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-12-18T22:16:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
19342024-12-18T22:16:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19352024-12-18T22:16:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19362024-12-18T22:16:33.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
19372024-12-18T22:16:33.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.111832ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
19382024-12-18T22:16:33.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19392024-12-18T22:16:33.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19402024-12-18T22:16:33.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.515868ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19412024-12-18T22:16:34.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b07d6913-4b7b-410f-98f8-b6d39f695ae5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19422024-12-18T22:16:34.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b07d6913-4b7b-410f-98f8-b6d39f695ae5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19432024-12-18T22:16:34.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b07d6913-4b7b-410f-98f8-b6d39f695ae5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19442024-12-18T22:16:35.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5bca09d-5b18-4bfd-b95c-bc8b49562964 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19452024-12-18T22:16:35.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5bca09d-5b18-4bfd-b95c-bc8b49562964 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19462024-12-18T22:16:35.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5bca09d-5b18-4bfd-b95c-bc8b49562964 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19472024-12-18T22:16:36.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3870e99f-705d-4f5c-8fa1-dba2da47739e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19482024-12-18T22:16:36.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3870e99f-705d-4f5c-8fa1-dba2da47739e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19492024-12-18T22:16:36.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3870e99f-705d-4f5c-8fa1-dba2da47739e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19502024-12-18T22:16:36.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 474 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 55bf8c18-2ecc-4923-8c2b-5c551a34fa18 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
19512024-12-18T22:16:37.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5749325-1eea-4a00-90eb-e84d24970284 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19522024-12-18T22:16:37.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5749325-1eea-4a00-90eb-e84d24970284 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19532024-12-18T22:16:37.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5749325-1eea-4a00-90eb-e84d24970284 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19542024-12-18T22:16:38.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d1e6110-c502-41f3-80c1-b772280f27c8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19552024-12-18T22:16:38.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d1e6110-c502-41f3-80c1-b772280f27c8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19562024-12-18T22:16:38.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d1e6110-c502-41f3-80c1-b772280f27c8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19572024-12-18T22:16:39.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 91829d88-5bdf-4e31-9861-ac0ca0ee676d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19582024-12-18T22:16:39.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 91829d88-5bdf-4e31-9861-ac0ca0ee676d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19592024-12-18T22:16:39.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 91829d88-5bdf-4e31-9861-ac0ca0ee676d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19602024-12-18T22:16:40.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6c4821ba-419a-4d2d-805d-d31d0570b312 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19612024-12-18T22:16:40.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6c4821ba-419a-4d2d-805d-d31d0570b312 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19622024-12-18T22:16:40.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6c4821ba-419a-4d2d-805d-d31d0570b312 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19632024-12-18T22:16:41.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9903d9c5-b165-4d78-9965-8811744ec289 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19642024-12-18T22:16:41.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9903d9c5-b165-4d78-9965-8811744ec289 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19652024-12-18T22:16:41.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9903d9c5-b165-4d78-9965-8811744ec289 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19662024-12-18T22:16:41.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = a1ab8edf-c240-429c-a2a7-1a1d968c7138 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
19672024-12-18T22:16:41.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = a1ab8edf-c240-429c-a2a7-1a1d968c7138 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
19682024-12-18T22:16:41.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = a1ab8edf-c240-429c-a2a7-1a1d968c7138 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
19692024-12-18T22:16:41.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = f5b8e6a8-206e-440b-97df-4918f7b72718 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
19702024-12-18T22:16:41.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = f5b8e6a8-206e-440b-97df-4918f7b72718 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
19712024-12-18T22:16:41.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = f5b8e6a8-206e-440b-97df-4918f7b72718 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
19722024-12-18T22:16:42.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37dfc1f1-5acc-49d7-a67a-3b0ceb2d2c7f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19732024-12-18T22:16:42.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37dfc1f1-5acc-49d7-a67a-3b0ceb2d2c7f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19742024-12-18T22:16:42.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37dfc1f1-5acc-49d7-a67a-3b0ceb2d2c7f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19752024-12-18T22:16:43.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = abd45f67-2823-4e2f-9862-e992ca7de5f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19762024-12-18T22:16:43.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = abd45f67-2823-4e2f-9862-e992ca7de5f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19772024-12-18T22:16:43.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = abd45f67-2823-4e2f-9862-e992ca7de5f1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19782024-12-18T22:16:43.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8cb173-65d1-441f-9ea8-94aa68feb53d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19792024-12-18T22:16:43.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8cb173-65d1-441f-9ea8-94aa68feb53d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19802024-12-18T22:16:43.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8cb173-65d1-441f-9ea8-94aa68feb53d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
19812024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
19822024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
19832024-12-18T22:16:43.790ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19842024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19852024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19862024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
19872024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
19882024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19892024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19902024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
19912024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
19922024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19932024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
19942024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19952024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
19962024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
19972024-12-18T22:16:43.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19982024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
19992024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20002024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20012024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
20022024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20032024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
20042024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
20052024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20062024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20072024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
20082024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20092024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
20102024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20112024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
20122024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20132024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
20142024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20152024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20162024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20172024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20182024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20192024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20202024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20212024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20222024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20232024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20242024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20252024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20262024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20272024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20282024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20292024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20302024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20312024-12-18T22:16:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20322024-12-18T22:16:43.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-12-18T22:16:43.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-12-18T22:16:43.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-12-18T22:16:43.794ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 418816187 } })
20362024-12-18T22:16:43.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20372024-12-18T22:16:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20382024-12-18T22:16:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20392024-12-18T22:16:43.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20402024-12-18T22:16:43.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20412024-12-18T22:16:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20422024-12-18T22:16:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20432024-12-18T22:16:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20442024-12-18T22:16:43.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.664012ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20452024-12-18T22:16:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20462024-12-18T22:16:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20472024-12-18T22:16:43.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20482024-12-18T22:16:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20492024-12-18T22:16:43.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502024-12-18T22:16:43.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512024-12-18T22:16:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20522024-12-18T22:16:43.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20532024-12-18T22:16:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20542024-12-18T22:16:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20552024-12-18T22:16:43.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20562024-12-18T22:16:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20572024-12-18T22:16:43.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 427535408 } })
20582024-12-18T22:16:43.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20592024-12-18T22:16:43.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20602024-12-18T22:16:43.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20612024-12-18T22:16:43.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20622024-12-18T22:16:43.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 430913894 } })
20632024-12-18T22:16:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20642024-12-18T22:16:43.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
20652024-12-18T22:16:43.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20662024-12-18T22:16:43.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.887401ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20672024-12-18T22:16:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20682024-12-18T22:16:43.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20692024-12-18T22:16:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20702024-12-18T22:16:43.840ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20712024-12-18T22:16:43.840ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20722024-12-18T22:16:43.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20732024-12-18T22:16:43.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20742024-12-18T22:16:43.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20752024-12-18T22:16:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20762024-12-18T22:16:43.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20772024-12-18T22:16:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20782024-12-18T22:16:43.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20792024-12-18T22:16:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20802024-12-18T22:16:43.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20812024-12-18T22:16:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20822024-12-18T22:16:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.635401ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
20832024-12-18T22:16:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.838006ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
20842024-12-18T22:16:43.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20852024-12-18T22:16:43.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20862024-12-18T22:16:43.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20872024-12-18T22:16:43.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882024-12-18T22:16:43.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20892024-12-18T22:16:43.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.0573ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20902024-12-18T22:16:43.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20912024-12-18T22:16:43.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20922024-12-18T22:16:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20932024-12-18T22:16:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20942024-12-18T22:16:43.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20952024-12-18T22:16:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20962024-12-18T22:16:43.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20972024-12-18T22:16:43.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20982024-12-18T22:16:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20992024-12-18T22:16:43.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
21002024-12-18T22:16:43.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21012024-12-18T22:16:43.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21022024-12-18T22:16:43.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21032024-12-18T22:16:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21042024-12-18T22:16:43.856ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.089497ms iteration = 6 status = 0
21052024-12-18T22:16:43.875ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21062024-12-18T22:16:43.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21072024-12-18T22:16:43.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21082024-12-18T22:16:43.875ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21092024-12-18T22:16:43.876ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c69fe8be-3bf4-4b4f-8c36-3b3408c95ba8", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21102024-12-18T22:16:43.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21112024-12-18T22:16:43.876ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21122024-12-18T22:16:43.876ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21132024-12-18T22:16:43.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21142024-12-18T22:16:43.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-12-18T22:16:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21162024-12-18T22:16:43.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21172024-12-18T22:16:43.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.306033ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21182024-12-18T22:16:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
21192024-12-18T22:16:43.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21202024-12-18T22:16:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21212024-12-18T22:16:43.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.015194ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21222024-12-18T22:16:43.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21232024-12-18T22:16:43.909ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21242024-12-18T22:16:43.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
21252024-12-18T22:16:43.909ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21262024-12-18T22:16:43.909ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afad478-d6f8-4d5c-93dd-7045fa8dfbe0", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21272024-12-18T22:16:43.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21282024-12-18T22:16:43.909ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "520fa854-180a-44d7-8852-447fb5ff80bb", "content-length": "26", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21292024-12-18T22:16:43.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21302024-12-18T22:16:43.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21312024-12-18T22:16:43.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
21322024-12-18T22:16:43.935ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.589046ms iteration = 8 status = {"physical_disks_added":0}
21332024-12-18T22:16:43.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21342024-12-18T22:16:43.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21352024-12-18T22:16:43.957ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21362024-12-18T22:16:43.957ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21372024-12-18T22:16:43.958ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "969b664f-9dd0-4567-9782-818a1ca32931", "content-length": "372", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21382024-12-18T22:16:43.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21392024-12-18T22:16:43.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21402024-12-18T22:16:43.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21412024-12-18T22:16:43.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21422024-12-18T22:16:43.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21432024-12-18T22:16:43.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21442024-12-18T22:16:43.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
21452024-12-18T22:16:43.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.385539ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
21462024-12-18T22:16:43.979ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21472024-12-18T22:16:43.979ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "93acfcc4-e5de-47c2-a182-9be1082e4e7b", "content-length": "1", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21482024-12-18T22:16:43.980ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21492024-12-18T22:16:43.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21502024-12-18T22:16:43.982ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 192.11386ms iteration = 6 status = null
21512024-12-18T22:16:43.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 203.85275ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21522024-12-18T22:16:43.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532024-12-18T22:16:43.996ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21542024-12-18T22:16:43.996ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21552024-12-18T22:16:43.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 205.878639ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21562024-12-18T22:16:43.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21572024-12-18T22:16:43.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21582024-12-18T22:16:43.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21592024-12-18T22:16:43.998ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.922279ms iteration = 6 status = {}
21602024-12-18T22:16:44.009ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21612024-12-18T22:16:44.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21622024-12-18T22:16:44.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "88408e79-d0a3-46a4-82fd-6ab9999ead6d", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21632024-12-18T22:16:44.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21642024-12-18T22:16:44.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21652024-12-18T22:16:44.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21662024-12-18T22:16:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21672024-12-18T22:16:44.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21682024-12-18T22:16:44.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21692024-12-18T22:16:44.019ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21702024-12-18T22:16:44.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21712024-12-18T22:16:44.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56171954-0f80-46d4-b57d-14c2ccd7d71e", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21722024-12-18T22:16:44.021ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 230.821389ms iteration = 6 status = {}
21732024-12-18T22:16:44.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21742024-12-18T22:16:44.066ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "808f7195-d58a-43cc-824b-fc6716c4c25c", "content-length": "691", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21752024-12-18T22:16:44.066ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21762024-12-18T22:16:44.066ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21772024-12-18T22:16:44.066ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21782024-12-18T22:16:44.068ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.606717ms iteration = 6 status = {}
21792024-12-18T22:16:44.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21802024-12-18T22:16:44.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21812024-12-18T22:16:44.094ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
21822024-12-18T22:16:44.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21832024-12-18T22:16:44.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21842024-12-18T22:16:44.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21852024-12-18T22:16:44.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64ec3ee4-2b09-4875-9288-cd8245a7a379", "content-length": "134", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
21862024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21872024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
21882024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21892024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21902024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21912024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21922024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21932024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21942024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21952024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21962024-12-18T22:16:44.204ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
21972024-12-18T22:16:44.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21982024-12-18T22:16:44.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21992024-12-18T22:16:44.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22002024-12-18T22:16:44.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c96655-4775-4229-9505-bc3fef6c096e", "content-length": "2", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
22012024-12-18T22:16:44.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22022024-12-18T22:16:44.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87ae3838-a9e3-4e4e-ba0f-0ab0bbb7cc9d", "content-length": "52", "date": "Wed, 18 Dec 2024 22:16:43 GMT"} })
22032024-12-18T22:16:44.216ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
22042024-12-18T22:16:44.217ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22052024-12-18T22:16:44.312ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a32dff42-4a49-482b-b67e-a0cdae3979ae", "date": "Wed, 18 Dec 2024 22:16:44 GMT"} })
22062024-12-18T22:16:44.312ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
22072024-12-18T22:16:44.312ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22082024-12-18T22:16:44.313ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "84ce7d69-ea79-41e2-bb2a-b4416799a90e", "content-length": "682", "date": "Wed, 18 Dec 2024 22:16:44 GMT"} })
22092024-12-18T22:16:44.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22102024-12-18T22:16:44.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22112024-12-18T22:16:44.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22122024-12-18T22:16:44.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22132024-12-18T22:16:44.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22142024-12-18T22:16:44.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22152024-12-18T22:16:44.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22162024-12-18T22:16:44.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22172024-12-18T22:16:44.440ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 649.953762ms iteration = 6 status = {}
22182024-12-18T22:16:44.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 152b8e91-a7ba-4115-b685-24e070f70a88 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22192024-12-18T22:16:44.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 152b8e91-a7ba-4115-b685-24e070f70a88 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22202024-12-18T22:16:44.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 152b8e91-a7ba-4115-b685-24e070f70a88 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22212024-12-18T22:16:45.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ffd4433c-7459-4029-8b9f-f5585179a930 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22222024-12-18T22:16:45.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ffd4433c-7459-4029-8b9f-f5585179a930 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22232024-12-18T22:16:45.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ffd4433c-7459-4029-8b9f-f5585179a930 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22242024-12-18T22:16:46.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9fc08bc-6c47-4b10-8401-3fe198ac5961 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22252024-12-18T22:16:46.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9fc08bc-6c47-4b10-8401-3fe198ac5961 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22262024-12-18T22:16:46.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9fc08bc-6c47-4b10-8401-3fe198ac5961 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22272024-12-18T22:16:46.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 63daa85b-ddc6-47f1-8d64-c84b56578b71 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
22282024-12-18T22:16:47.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 06762d70-2191-4780-9f2d-339aa259623f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22292024-12-18T22:16:47.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 06762d70-2191-4780-9f2d-339aa259623f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22302024-12-18T22:16:47.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 06762d70-2191-4780-9f2d-339aa259623f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22312024-12-18T22:16:48.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7cc4898-2965-4240-b18c-655849462e73 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22322024-12-18T22:16:48.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7cc4898-2965-4240-b18c-655849462e73 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22332024-12-18T22:16:48.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7cc4898-2965-4240-b18c-655849462e73 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22342024-12-18T22:16:49.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e861fb0-15c6-40be-a25b-cbb439a99893 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22352024-12-18T22:16:49.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e861fb0-15c6-40be-a25b-cbb439a99893 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22362024-12-18T22:16:49.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e861fb0-15c6-40be-a25b-cbb439a99893 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22372024-12-18T22:16:50.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a64c1c3-a74e-46c3-8756-241222b1663c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22382024-12-18T22:16:50.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a64c1c3-a74e-46c3-8756-241222b1663c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22392024-12-18T22:16:50.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a64c1c3-a74e-46c3-8756-241222b1663c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22402024-12-18T22:16:51.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2187145-f44f-4755-8163-8b32671e7325 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22412024-12-18T22:16:51.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2187145-f44f-4755-8163-8b32671e7325 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22422024-12-18T22:16:51.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2187145-f44f-4755-8163-8b32671e7325 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22432024-12-18T22:16:52.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae079864-6457-47b4-bed9-edee995c5456 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22442024-12-18T22:16:52.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae079864-6457-47b4-bed9-edee995c5456 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22452024-12-18T22:16:52.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae079864-6457-47b4-bed9-edee995c5456 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22462024-12-18T22:16:53.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c1df638-b500-4aaa-945b-5d36bfaf315d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22472024-12-18T22:16:53.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c1df638-b500-4aaa-945b-5d36bfaf315d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22482024-12-18T22:16:53.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7c1df638-b500-4aaa-945b-5d36bfaf315d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22492024-12-18T22:16:53.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
22502024-12-18T22:16:53.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22512024-12-18T22:16:53.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
22522024-12-18T22:16:53.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22532024-12-18T22:16:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22542024-12-18T22:16:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22552024-12-18T22:16:53.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22562024-12-18T22:16:53.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22572024-12-18T22:16:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22582024-12-18T22:16:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22592024-12-18T22:16:53.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22602024-12-18T22:16:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22612024-12-18T22:16:53.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.750253ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22622024-12-18T22:16:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22632024-12-18T22:16:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22642024-12-18T22:16:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652024-12-18T22:16:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
22662024-12-18T22:16:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22672024-12-18T22:16:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22682024-12-18T22:16:53.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
22692024-12-18T22:16:53.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.624825ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
22702024-12-18T22:16:54.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3e0543c-709c-419b-965d-2163f6a9b2aa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22712024-12-18T22:16:54.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3e0543c-709c-419b-965d-2163f6a9b2aa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22722024-12-18T22:16:54.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3e0543c-709c-419b-965d-2163f6a9b2aa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22732024-12-18T22:16:55.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec3b09ba-a4f7-4a89-ad06-0eb4e535075d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22742024-12-18T22:16:55.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec3b09ba-a4f7-4a89-ad06-0eb4e535075d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22752024-12-18T22:16:55.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec3b09ba-a4f7-4a89-ad06-0eb4e535075d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22762024-12-18T22:16:56.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5788a428-926d-478b-9833-062e4fb3c477 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
22772024-12-18T22:16:56.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb369e72-7aad-4b32-8bac-19a785d57dcb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22782024-12-18T22:16:56.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb369e72-7aad-4b32-8bac-19a785d57dcb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22792024-12-18T22:16:56.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb369e72-7aad-4b32-8bac-19a785d57dcb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22802024-12-18T22:16:57.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f52077-cddd-44c3-a566-3b1165a4c8e1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22812024-12-18T22:16:57.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f52077-cddd-44c3-a566-3b1165a4c8e1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22822024-12-18T22:16:57.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f52077-cddd-44c3-a566-3b1165a4c8e1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22832024-12-18T22:16:58.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7c4a104-ab15-442d-8236-e578c4cf5f7e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22842024-12-18T22:16:58.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7c4a104-ab15-442d-8236-e578c4cf5f7e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22852024-12-18T22:16:58.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7c4a104-ab15-442d-8236-e578c4cf5f7e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22862024-12-18T22:16:59.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75faf611-99ab-4c4d-8ece-10521fd91409 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22872024-12-18T22:16:59.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75faf611-99ab-4c4d-8ece-10521fd91409 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22882024-12-18T22:16:59.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75faf611-99ab-4c4d-8ece-10521fd91409 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22892024-12-18T22:17:00.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c13f8483-95d0-47c7-b2e0-2ecfac39f250 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22902024-12-18T22:17:00.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c13f8483-95d0-47c7-b2e0-2ecfac39f250 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22912024-12-18T22:17:00.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c13f8483-95d0-47c7-b2e0-2ecfac39f250 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22922024-12-18T22:17:01.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f4b809-4f4a-4fcc-a748-8498a3efe6ba roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22932024-12-18T22:17:01.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f4b809-4f4a-4fcc-a748-8498a3efe6ba resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22942024-12-18T22:17:01.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f4b809-4f4a-4fcc-a748-8498a3efe6ba response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22952024-12-18T22:17:02.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb9d1aad-3943-4af1-bdef-f01e2594e2d0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22962024-12-18T22:17:02.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb9d1aad-3943-4af1-bdef-f01e2594e2d0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22972024-12-18T22:17:02.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb9d1aad-3943-4af1-bdef-f01e2594e2d0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
22982024-12-18T22:17:03.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
22992024-12-18T22:17:03.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23002024-12-18T22:17:03.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
23012024-12-18T22:17:03.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-12-18T22:17:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23032024-12-18T22:17:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23042024-12-18T22:17:03.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052024-12-18T22:17:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23062024-12-18T22:17:03.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23072024-12-18T22:17:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23082024-12-18T22:17:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23092024-12-18T22:17:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23102024-12-18T22:17:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112024-12-18T22:17:03.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
23122024-12-18T22:17:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23132024-12-18T22:17:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23142024-12-18T22:17:03.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
23152024-12-18T22:17:03.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.570303ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
23162024-12-18T22:17:03.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23172024-12-18T22:17:03.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23182024-12-18T22:17:03.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.138108ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23192024-12-18T22:17:03.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d17db304-39fc-4c9c-b794-c925bab1c2bb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23202024-12-18T22:17:03.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d17db304-39fc-4c9c-b794-c925bab1c2bb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23212024-12-18T22:17:03.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d17db304-39fc-4c9c-b794-c925bab1c2bb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23222024-12-18T22:17:04.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e22106d-48f4-4c70-8e0e-e75c47d33759 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23232024-12-18T22:17:04.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e22106d-48f4-4c70-8e0e-e75c47d33759 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23242024-12-18T22:17:04.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e22106d-48f4-4c70-8e0e-e75c47d33759 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23252024-12-18T22:17:05.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd1111ff-f49c-4523-b771-cc12166590f7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23262024-12-18T22:17:05.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd1111ff-f49c-4523-b771-cc12166590f7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23272024-12-18T22:17:05.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd1111ff-f49c-4523-b771-cc12166590f7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23282024-12-18T22:17:06.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5872ca05-a386-4c9c-aecf-bc0db2a90958 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
23292024-12-18T22:17:06.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1971b2-7cb1-4bbb-bb7d-ad00d62aa6d3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23302024-12-18T22:17:06.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1971b2-7cb1-4bbb-bb7d-ad00d62aa6d3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23312024-12-18T22:17:06.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1971b2-7cb1-4bbb-bb7d-ad00d62aa6d3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23322024-12-18T22:17:07.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69a3b2c6-e890-4142-9e3d-2cf6c669a231 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23332024-12-18T22:17:07.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69a3b2c6-e890-4142-9e3d-2cf6c669a231 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23342024-12-18T22:17:07.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69a3b2c6-e890-4142-9e3d-2cf6c669a231 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23352024-12-18T22:17:09.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 845c4782-c7e3-4e0f-9c9e-d48e839230be roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23362024-12-18T22:17:09.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 845c4782-c7e3-4e0f-9c9e-d48e839230be resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23372024-12-18T22:17:09.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 845c4782-c7e3-4e0f-9c9e-d48e839230be response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23382024-12-18T22:17:10.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d643507-13ba-48e6-bdd1-ff840941aad0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23392024-12-18T22:17:10.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d643507-13ba-48e6-bdd1-ff840941aad0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23402024-12-18T22:17:10.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d643507-13ba-48e6-bdd1-ff840941aad0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23412024-12-18T22:17:11.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c7c6cbd-9b08-49c7-854f-5529414b3fba roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23422024-12-18T22:17:11.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c7c6cbd-9b08-49c7-854f-5529414b3fba resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23432024-12-18T22:17:11.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c7c6cbd-9b08-49c7-854f-5529414b3fba response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23442024-12-18T22:17:12.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5cbfadd4-6028-496b-97e4-9fa88e552743 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23452024-12-18T22:17:12.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5cbfadd4-6028-496b-97e4-9fa88e552743 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23462024-12-18T22:17:12.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5cbfadd4-6028-496b-97e4-9fa88e552743 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23472024-12-18T22:17:13.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 30411082-a99e-4c27-9a91-5f8d037faa3e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23482024-12-18T22:17:13.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 30411082-a99e-4c27-9a91-5f8d037faa3e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23492024-12-18T22:17:13.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 30411082-a99e-4c27-9a91-5f8d037faa3e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
23502024-12-18T22:17:13.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 64f3e55b-315f-45a7-b17d-3f519f019569 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23512024-12-18T22:17:13.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 64f3e55b-315f-45a7-b17d-3f519f019569 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23522024-12-18T22:17:13.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 64f3e55b-315f-45a7-b17d-3f519f019569 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23532024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
23542024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
23552024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23562024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23572024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
23582024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23592024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
23602024-12-18T22:17:13.791ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23612024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23622024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
23632024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23642024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23652024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
23662024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
23672024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23682024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
23692024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23702024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
23712024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23722024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
23732024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23742024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
23752024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
23762024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23772024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
23782024-12-18T22:17:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23792024-12-18T22:17:13.791ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
23802024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
23812024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.741\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
23822024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
23832024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23842024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
23852024-12-18T22:17:13.792ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:07:13.791895673 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23862024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
23872024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
23882024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23892024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23902024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23912024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
23922024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
23932024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
23942024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23952024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
23962024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23972024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
23982024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
23992024-12-18T22:17:13.792ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24002024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24012024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24022024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
24032024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
24042024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24052024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24062024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
24072024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24082024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
24092024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24102024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
24112024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24122024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24132024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
24142024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24152024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
24162024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24172024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24182024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24192024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24202024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24212024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24222024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24232024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24242024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24252024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24262024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24272024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24282024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24292024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24302024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24312024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24322024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24332024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24342024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24352024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24362024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24372024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24382024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24392024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24402024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24412024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24422024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24432024-12-18T22:17:13.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 416501411 } })
24442024-12-18T22:17:13.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 416507491 } })
24452024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24462024-12-18T22:17:13.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24472024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24482024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24492024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24502024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24512024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
24522024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.52425ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
24532024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24542024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.441298ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24552024-12-18T22:17:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24562024-12-18T22:17:13.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572024-12-18T22:17:13.794ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582024-12-18T22:17:13.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592024-12-18T22:17:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24602024-12-18T22:17:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24612024-12-18T22:17:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.354095ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24622024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24632024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24642024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24652024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24662024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24672024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24682024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24702024-12-18T22:17:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712024-12-18T22:17:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24722024-12-18T22:17:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24732024-12-18T22:17:13.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 423990878 } })
24742024-12-18T22:17:13.800ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24752024-12-18T22:17:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.966987ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
24762024-12-18T22:17:13.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 425172912 } })
24772024-12-18T22:17:13.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24782024-12-18T22:17:13.805ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24792024-12-18T22:17:13.805ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24802024-12-18T22:17:13.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24812024-12-18T22:17:13.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24822024-12-18T22:17:13.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24832024-12-18T22:17:13.810ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24842024-12-18T22:17:13.810ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24852024-12-18T22:17:13.810ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.718418ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24862024-12-18T22:17:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24872024-12-18T22:17:13.810ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24882024-12-18T22:17:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24892024-12-18T22:17:13.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24902024-12-18T22:17:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24912024-12-18T22:17:13.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24922024-12-18T22:17:13.813ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:07:13.791895673 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24932024-12-18T22:17:13.813ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.809668ms iteration = 4 status = {"expiration":"2024-12-18T22:07:13.791895673Z","pruned":[]}
24942024-12-18T22:17:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24952024-12-18T22:17:13.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24962024-12-18T22:17:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24972024-12-18T22:17:13.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24982024-12-18T22:17:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24992024-12-18T22:17:13.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002024-12-18T22:17:13.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25012024-12-18T22:17:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25022024-12-18T22:17:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25032024-12-18T22:17:13.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25042024-12-18T22:17:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25052024-12-18T22:17:13.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062024-12-18T22:17:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25072024-12-18T22:17:13.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25082024-12-18T22:17:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25092024-12-18T22:17:13.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 459780240 } })
25102024-12-18T22:17:13.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
25112024-12-18T22:17:13.837ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25122024-12-18T22:17:13.838ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25132024-12-18T22:17:13.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25142024-12-18T22:17:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25152024-12-18T22:17:13.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.311887ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
25162024-12-18T22:17:13.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25172024-12-18T22:17:13.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25182024-12-18T22:17:13.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-12-18T22:17:13.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25202024-12-18T22:17:13.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25212024-12-18T22:17:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25222024-12-18T22:17:13.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-12-18T22:17:13.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.151931ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25242024-12-18T22:17:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25252024-12-18T22:17:13.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25262024-12-18T22:17:13.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272024-12-18T22:17:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25282024-12-18T22:17:13.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25292024-12-18T22:17:13.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25302024-12-18T22:17:13.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25312024-12-18T22:17:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25322024-12-18T22:17:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25332024-12-18T22:17:13.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-12-18T22:17:13.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25352024-12-18T22:17:13.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25362024-12-18T22:17:13.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25372024-12-18T22:17:13.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25382024-12-18T22:17:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25392024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25402024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25412024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25422024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25432024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25442024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25452024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25462024-12-18T22:17:13.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25472024-12-18T22:17:13.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25482024-12-18T22:17:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25492024-12-18T22:17:13.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25502024-12-18T22:17:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25512024-12-18T22:17:13.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.262061ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
25522024-12-18T22:17:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25532024-12-18T22:17:13.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25542024-12-18T22:17:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25552024-12-18T22:17:13.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25562024-12-18T22:17:13.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25572024-12-18T22:17:13.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-12-18T22:17:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-12-18T22:17:13.859ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25602024-12-18T22:17:13.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.162167ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25612024-12-18T22:17:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25622024-12-18T22:17:13.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25632024-12-18T22:17:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25642024-12-18T22:17:13.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25652024-12-18T22:17:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25662024-12-18T22:17:13.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.953972ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25672024-12-18T22:17:13.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.417601ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25682024-12-18T22:17:13.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25692024-12-18T22:17:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25702024-12-18T22:17:13.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25712024-12-18T22:17:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25722024-12-18T22:17:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 73.486812ms iteration = 3 status = {"nsuccess":5}
25732024-12-18T22:17:13.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25742024-12-18T22:17:13.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25752024-12-18T22:17:13.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762024-12-18T22:17:13.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25772024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25782024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25792024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25802024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25812024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25822024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25832024-12-18T22:17:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25842024-12-18T22:17:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
25852024-12-18T22:17:13.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25862024-12-18T22:17:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25872024-12-18T22:17:13.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25882024-12-18T22:17:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25892024-12-18T22:17:13.871ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25902024-12-18T22:17:13.871ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25912024-12-18T22:17:13.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.648013ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25922024-12-18T22:17:13.872ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25932024-12-18T22:17:13.872ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25942024-12-18T22:17:13.872ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25952024-12-18T22:17:13.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25962024-12-18T22:17:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25972024-12-18T22:17:13.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25982024-12-18T22:17:13.873ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25992024-12-18T22:17:13.873ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
26002024-12-18T22:17:13.873ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.953737ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26012024-12-18T22:17:13.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26022024-12-18T22:17:13.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26032024-12-18T22:17:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
26042024-12-18T22:17:13.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26052024-12-18T22:17:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26062024-12-18T22:17:13.877ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.280742ms iteration = 7 status = 0
26072024-12-18T22:17:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26082024-12-18T22:17:13.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26092024-12-18T22:17:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26102024-12-18T22:17:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26112024-12-18T22:17:13.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26122024-12-18T22:17:13.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26132024-12-18T22:17:13.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26142024-12-18T22:17:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26152024-12-18T22:17:13.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26162024-12-18T22:17:13.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
26172024-12-18T22:17:13.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.195609ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
26182024-12-18T22:17:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26192024-12-18T22:17:13.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26202024-12-18T22:17:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26212024-12-18T22:17:13.886ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26222024-12-18T22:17:13.886ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26232024-12-18T22:17:13.886ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
26242024-12-18T22:17:13.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 95.170597ms iteration = 4 status = {"generation":1}
26252024-12-18T22:17:13.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26262024-12-18T22:17:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26272024-12-18T22:17:13.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26282024-12-18T22:17:13.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26292024-12-18T22:17:13.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302024-12-18T22:17:13.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.613633ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26312024-12-18T22:17:13.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26322024-12-18T22:17:13.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26332024-12-18T22:17:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26342024-12-18T22:17:13.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-12-18T22:17:13.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26362024-12-18T22:17:13.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26372024-12-18T22:17:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26382024-12-18T22:17:13.916ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26392024-12-18T22:17:13.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26402024-12-18T22:17:13.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26412024-12-18T22:17:13.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26422024-12-18T22:17:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26432024-12-18T22:17:13.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-12-18T22:17:13.920ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.188625ms iteration = 9 status = {"physical_disks_added":0}
26452024-12-18T22:17:13.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26462024-12-18T22:17:13.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26472024-12-18T22:17:13.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26482024-12-18T22:17:13.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26492024-12-18T22:17:13.923ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26502024-12-18T22:17:13.923ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
26512024-12-18T22:17:13.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26522024-12-18T22:17:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26532024-12-18T22:17:13.942ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
26542024-12-18T22:17:13.942ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 150.157706ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26552024-12-18T22:17:13.959ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26562024-12-18T22:17:13.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 167.220861ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26572024-12-18T22:17:13.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26582024-12-18T22:17:13.977ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26592024-12-18T22:17:13.977ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec9ad762-ad52-4321-8d71-452124590ff0", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
26602024-12-18T22:17:13.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26612024-12-18T22:17:13.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26622024-12-18T22:17:14.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
26632024-12-18T22:17:14.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26642024-12-18T22:17:14.020ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bec3c01-d401-43a0-ae49-8d01a44c954b", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
26652024-12-18T22:17:14.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26662024-12-18T22:17:14.022ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
26672024-12-18T22:17:14.094ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26682024-12-18T22:17:14.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b18a0bef-886c-4bfb-b2ac-feee99bcf9f2", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26692024-12-18T22:17:14.094ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26702024-12-18T22:17:14.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fe301e93-fb3f-4851-9136-506abee617c0", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26712024-12-18T22:17:14.095ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26722024-12-18T22:17:14.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26732024-12-18T22:17:14.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.527574ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26742024-12-18T22:17:14.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26752024-12-18T22:17:14.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7028f492-e308-4bf1-9a0a-ba61d837bb9c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
26762024-12-18T22:17:14.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7028f492-e308-4bf1-9a0a-ba61d837bb9c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
26772024-12-18T22:17:14.136ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26782024-12-18T22:17:14.136ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26792024-12-18T22:17:14.136ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c477f7-473c-4b79-9d10-47f6adcfa057", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
26802024-12-18T22:17:14.136ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26812024-12-18T22:17:14.138ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26822024-12-18T22:17:14.191ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 399.688492ms iteration = 7 status = {}
26832024-12-18T22:17:14.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26842024-12-18T22:17:14.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c7950d7-3c9b-47db-8a86-0ec7e7b58dee", "content-length": "691", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
26852024-12-18T22:17:14.234ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26862024-12-18T22:17:14.234ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26872024-12-18T22:17:14.234ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26882024-12-18T22:17:14.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26892024-12-18T22:17:14.235ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 443.91316ms iteration = 7 status = {}
26902024-12-18T22:17:14.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7028f492-e308-4bf1-9a0a-ba61d837bb9c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
26912024-12-18T22:17:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26922024-12-18T22:17:14.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26932024-12-18T22:17:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26942024-12-18T22:17:14.240ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
26952024-12-18T22:17:14.240ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26962024-12-18T22:17:14.240ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
26972024-12-18T22:17:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 449.121672ms iteration = 4 status = {"generation":2}
26982024-12-18T22:17:14.255ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26992024-12-18T22:17:14.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27002024-12-18T22:17:14.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8152625-2ecb-44c1-ab20-cc7fae47fcac", "content-length": "372", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
27012024-12-18T22:17:14.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27022024-12-18T22:17:14.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27032024-12-18T22:17:14.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27042024-12-18T22:17:14.270ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27052024-12-18T22:17:14.270ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27062024-12-18T22:17:14.270ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a5e189f5-c75f-4499-af8d-a015df89ec76", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
27072024-12-18T22:17:14.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27082024-12-18T22:17:14.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27092024-12-18T22:17:14.271ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27102024-12-18T22:17:14.271ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7196c990-ee87-4ea1-84d6-c8134fba1858", "content-length": "1", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27112024-12-18T22:17:14.272ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27122024-12-18T22:17:14.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27132024-12-18T22:17:14.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27142024-12-18T22:17:14.274ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 482.12367ms iteration = 7 status = null
27152024-12-18T22:17:14.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27162024-12-18T22:17:14.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27172024-12-18T22:17:14.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27182024-12-18T22:17:14.280ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27192024-12-18T22:17:14.280ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27202024-12-18T22:17:14.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "752ac3ac-4791-4c8f-9328-2b1179552cfb", "date": "Wed, 18 Dec 2024 22:17:13 GMT"} })
27212024-12-18T22:17:14.282ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.145927ms iteration = 7 status = {}
27222024-12-18T22:17:14.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27232024-12-18T22:17:14.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "70a6346f-3a05-4326-accb-b952a93e1f6c", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27242024-12-18T22:17:14.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27252024-12-18T22:17:14.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1189eb9-a50f-4dc9-bf29-1b4f26ab5e56", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27262024-12-18T22:17:14.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27272024-12-18T22:17:14.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "426459dd-9fc4-4d8f-8c60-27131229761e", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27282024-12-18T22:17:14.335ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27292024-12-18T22:17:14.337ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27302024-12-18T22:17:14.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 545.974982ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27312024-12-18T22:17:14.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27322024-12-18T22:17:14.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27332024-12-18T22:17:14.348ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
27342024-12-18T22:17:14.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27352024-12-18T22:17:14.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27362024-12-18T22:17:14.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27372024-12-18T22:17:14.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "41d475fa-0583-4614-99cf-e3c4ca3976cf", "content-length": "134", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27382024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27392024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
27402024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27412024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27422024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27432024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27442024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27452024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27462024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27472024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27482024-12-18T22:17:14.462ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
27492024-12-18T22:17:14.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27502024-12-18T22:17:14.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27512024-12-18T22:17:14.464ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27522024-12-18T22:17:14.464ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "984ee90c-5436-47fc-abe2-7e1ed9cabf4f", "content-length": "2", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27532024-12-18T22:17:14.464ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27542024-12-18T22:17:14.464ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f9c7cc1-6ef6-4210-b694-6f8412ecee06", "content-length": "52", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27552024-12-18T22:17:14.464ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
27562024-12-18T22:17:14.464ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27572024-12-18T22:17:14.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d6d8a5f4-c12f-4c42-9b9d-a6c24d4fd5ca", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27582024-12-18T22:17:14.561ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
27592024-12-18T22:17:14.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27602024-12-18T22:17:14.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea76f9fe-dc1c-4f3d-a43e-a3e944d4be7f", "content-length": "682", "date": "Wed, 18 Dec 2024 22:17:14 GMT"} })
27612024-12-18T22:17:14.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27622024-12-18T22:17:14.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27632024-12-18T22:17:14.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27642024-12-18T22:17:14.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27652024-12-18T22:17:14.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27662024-12-18T22:17:14.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27672024-12-18T22:17:14.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-12-18T22:17:14.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27692024-12-18T22:17:14.689ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 897.930577ms iteration = 7 status = {}
27702024-12-18T22:17:15.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 54df8a64-a215-4415-9f34-f4be1877f901 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27712024-12-18T22:17:15.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 54df8a64-a215-4415-9f34-f4be1877f901 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27722024-12-18T22:17:15.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 54df8a64-a215-4415-9f34-f4be1877f901 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27732024-12-18T22:17:16.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0659f0bf-ee30-40da-b798-c74c332a6e2c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27742024-12-18T22:17:16.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0659f0bf-ee30-40da-b798-c74c332a6e2c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27752024-12-18T22:17:16.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0659f0bf-ee30-40da-b798-c74c332a6e2c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27762024-12-18T22:17:16.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 9d3f691a-0bfb-429e-bd7b-547c93d85bb4 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
27772024-12-18T22:17:17.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4a88349-5db5-469b-af27-ea9f1cc74551 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27782024-12-18T22:17:17.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4a88349-5db5-469b-af27-ea9f1cc74551 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27792024-12-18T22:17:17.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4a88349-5db5-469b-af27-ea9f1cc74551 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27802024-12-18T22:17:18.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd4e71da-e0e9-4fd3-a6a9-3b2f5e853b29 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27812024-12-18T22:17:18.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd4e71da-e0e9-4fd3-a6a9-3b2f5e853b29 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27822024-12-18T22:17:18.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd4e71da-e0e9-4fd3-a6a9-3b2f5e853b29 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27832024-12-18T22:17:19.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = caf63c99-df84-4cfe-ac30-7a7950f08b22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27842024-12-18T22:17:19.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = caf63c99-df84-4cfe-ac30-7a7950f08b22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27852024-12-18T22:17:19.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = caf63c99-df84-4cfe-ac30-7a7950f08b22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27862024-12-18T22:17:20.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3da9929c-def9-4899-b3df-b6882eabe0b3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27872024-12-18T22:17:20.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3da9929c-def9-4899-b3df-b6882eabe0b3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27882024-12-18T22:17:20.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3da9929c-def9-4899-b3df-b6882eabe0b3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27892024-12-18T22:17:21.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5604689d-c9e5-4e01-add3-b72450687d3a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27902024-12-18T22:17:21.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5604689d-c9e5-4e01-add3-b72450687d3a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27912024-12-18T22:17:21.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5604689d-c9e5-4e01-add3-b72450687d3a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27922024-12-18T22:17:22.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e83965d5-b390-4e4d-b5dd-0fbd21732bfa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27932024-12-18T22:17:22.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e83965d5-b390-4e4d-b5dd-0fbd21732bfa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27942024-12-18T22:17:22.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e83965d5-b390-4e4d-b5dd-0fbd21732bfa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27952024-12-18T22:17:23.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b1fa0a0-6e2d-4a5b-9487-41cf8350a82a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27962024-12-18T22:17:23.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b1fa0a0-6e2d-4a5b-9487-41cf8350a82a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27972024-12-18T22:17:23.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b1fa0a0-6e2d-4a5b-9487-41cf8350a82a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
27982024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
27992024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28002024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
28012024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28032024-12-18T22:17:23.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28042024-12-18T22:17:23.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28052024-12-18T22:17:23.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28062024-12-18T22:17:23.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-12-18T22:17:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28082024-12-18T22:17:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28092024-12-18T22:17:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28102024-12-18T22:17:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28112024-12-18T22:17:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28122024-12-18T22:17:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28132024-12-18T22:17:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
28142024-12-18T22:17:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28152024-12-18T22:17:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28162024-12-18T22:17:23.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.446027ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28172024-12-18T22:17:23.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
28182024-12-18T22:17:23.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.872359ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
28192024-12-18T22:17:24.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05491557-d88f-4469-a13b-b3d2c4871f8d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28202024-12-18T22:17:24.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05491557-d88f-4469-a13b-b3d2c4871f8d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28212024-12-18T22:17:24.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05491557-d88f-4469-a13b-b3d2c4871f8d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28222024-12-18T22:17:25.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = da32e1b5-a593-4acf-8c05-91b5b38e0b5d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28232024-12-18T22:17:25.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = da32e1b5-a593-4acf-8c05-91b5b38e0b5d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28242024-12-18T22:17:25.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = da32e1b5-a593-4acf-8c05-91b5b38e0b5d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28252024-12-18T22:17:26.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b93f74-71ae-423e-b624-d7d0e25b151b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28262024-12-18T22:17:26.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b93f74-71ae-423e-b624-d7d0e25b151b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28272024-12-18T22:17:26.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b93f74-71ae-423e-b624-d7d0e25b151b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28282024-12-18T22:17:26.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 89f3910c-7522-4c1b-8f6a-ed73c60c43b3 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
28292024-12-18T22:17:27.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 624584c5-ab7d-4098-bf88-8d71806e6c60 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28302024-12-18T22:17:27.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 624584c5-ab7d-4098-bf88-8d71806e6c60 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28312024-12-18T22:17:27.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 624584c5-ab7d-4098-bf88-8d71806e6c60 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28322024-12-18T22:17:28.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55cfcb2f-4aab-4daf-9362-822b1b6387a6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28332024-12-18T22:17:28.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55cfcb2f-4aab-4daf-9362-822b1b6387a6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28342024-12-18T22:17:28.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 55cfcb2f-4aab-4daf-9362-822b1b6387a6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28352024-12-18T22:17:29.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7003d5e6-2bb2-400d-84f5-9aa7ee54d753 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28362024-12-18T22:17:29.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7003d5e6-2bb2-400d-84f5-9aa7ee54d753 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28372024-12-18T22:17:29.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7003d5e6-2bb2-400d-84f5-9aa7ee54d753 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28382024-12-18T22:17:30.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b430f96-7b4f-40fb-96e3-e5f400f7d692 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28392024-12-18T22:17:30.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b430f96-7b4f-40fb-96e3-e5f400f7d692 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28402024-12-18T22:17:30.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b430f96-7b4f-40fb-96e3-e5f400f7d692 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28412024-12-18T22:17:31.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e43fb17c-f84d-447c-97a7-29a51a129aee roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28422024-12-18T22:17:31.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e43fb17c-f84d-447c-97a7-29a51a129aee resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28432024-12-18T22:17:31.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e43fb17c-f84d-447c-97a7-29a51a129aee response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28442024-12-18T22:17:32.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62e22b48-083e-43b9-8bf7-242ee90611fe roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28452024-12-18T22:17:32.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62e22b48-083e-43b9-8bf7-242ee90611fe resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28462024-12-18T22:17:32.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62e22b48-083e-43b9-8bf7-242ee90611fe response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28472024-12-18T22:17:33.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ebcf2c68-6802-4655-8592-0ee0d4b22292 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28482024-12-18T22:17:33.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ebcf2c68-6802-4655-8592-0ee0d4b22292 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28492024-12-18T22:17:33.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ebcf2c68-6802-4655-8592-0ee0d4b22292 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28502024-12-18T22:17:33.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
28512024-12-18T22:17:33.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
28522024-12-18T22:17:33.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28532024-12-18T22:17:33.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28542024-12-18T22:17:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28552024-12-18T22:17:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28562024-12-18T22:17:33.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28572024-12-18T22:17:33.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28582024-12-18T22:17:33.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28592024-12-18T22:17:33.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.393916ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28602024-12-18T22:17:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28612024-12-18T22:17:33.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28622024-12-18T22:17:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28632024-12-18T22:17:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28642024-12-18T22:17:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28652024-12-18T22:17:33.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28662024-12-18T22:17:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
28672024-12-18T22:17:33.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682024-12-18T22:17:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28692024-12-18T22:17:33.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
28702024-12-18T22:17:33.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.588164ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
28712024-12-18T22:17:34.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3e90fd-6984-4e9a-8517-386349783ad3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28722024-12-18T22:17:34.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3e90fd-6984-4e9a-8517-386349783ad3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28732024-12-18T22:17:34.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3e90fd-6984-4e9a-8517-386349783ad3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28742024-12-18T22:17:35.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bbbfa85d-284c-4ed7-8974-05ef58034285 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28752024-12-18T22:17:35.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bbbfa85d-284c-4ed7-8974-05ef58034285 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28762024-12-18T22:17:35.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bbbfa85d-284c-4ed7-8974-05ef58034285 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28772024-12-18T22:17:36.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 308c2bea-d4aa-452d-9e45-9edaf1e56c2c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
28782024-12-18T22:17:36.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5238d0e-864e-4d44-b919-c7d0d5d76e64 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28792024-12-18T22:17:36.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5238d0e-864e-4d44-b919-c7d0d5d76e64 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28802024-12-18T22:17:36.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5238d0e-864e-4d44-b919-c7d0d5d76e64 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28812024-12-18T22:17:37.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15ec81ba-8d9a-4c5f-a2d6-7eefd75ef486 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28822024-12-18T22:17:37.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15ec81ba-8d9a-4c5f-a2d6-7eefd75ef486 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28832024-12-18T22:17:37.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15ec81ba-8d9a-4c5f-a2d6-7eefd75ef486 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28842024-12-18T22:17:38.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac2879f4-21fc-4fbe-ac69-f27922847096 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28852024-12-18T22:17:38.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac2879f4-21fc-4fbe-ac69-f27922847096 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28862024-12-18T22:17:38.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac2879f4-21fc-4fbe-ac69-f27922847096 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28872024-12-18T22:17:39.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b998b4f0-675b-44e8-bded-d0954934db4a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28882024-12-18T22:17:39.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b998b4f0-675b-44e8-bded-d0954934db4a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28892024-12-18T22:17:39.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b998b4f0-675b-44e8-bded-d0954934db4a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28902024-12-18T22:17:40.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c9347379-69c0-426e-a0d3-3a293a6d2182 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28912024-12-18T22:17:40.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c9347379-69c0-426e-a0d3-3a293a6d2182 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28922024-12-18T22:17:40.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c9347379-69c0-426e-a0d3-3a293a6d2182 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28932024-12-18T22:17:41.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be07a1c7-1aa2-492e-bce6-e4b6e371870b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28942024-12-18T22:17:41.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be07a1c7-1aa2-492e-bce6-e4b6e371870b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28952024-12-18T22:17:41.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be07a1c7-1aa2-492e-bce6-e4b6e371870b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28962024-12-18T22:17:42.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fde4a8c8-14c7-452a-a1b7-8e94b34f870e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28972024-12-18T22:17:42.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fde4a8c8-14c7-452a-a1b7-8e94b34f870e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28982024-12-18T22:17:42.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fde4a8c8-14c7-452a-a1b7-8e94b34f870e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
28992024-12-18T22:17:43.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e380c1fa-a6c3-465d-9e72-7dd27ceff181 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29002024-12-18T22:17:43.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e380c1fa-a6c3-465d-9e72-7dd27ceff181 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29012024-12-18T22:17:43.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e380c1fa-a6c3-465d-9e72-7dd27ceff181 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29022024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
29032024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
29042024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29052024-12-18T22:17:43.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29062024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29072024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
29082024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29092024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
29102024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
29112024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29122024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
29132024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29142024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
29152024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29162024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
29172024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
29182024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29192024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29202024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
29212024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29222024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
29232024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29242024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29252024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
29262024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29272024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
29282024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29292024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
29302024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29312024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
29322024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29332024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
29342024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
29352024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29362024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29372024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29382024-12-18T22:17:43.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29402024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29412024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29422024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29432024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29442024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29452024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29462024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29472024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29482024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29492024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29502024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29512024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29522024-12-18T22:17:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29532024-12-18T22:17:43.794ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 417604813 } })
29542024-12-18T22:17:43.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29552024-12-18T22:17:43.794ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29562024-12-18T22:17:43.794ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.958978ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29572024-12-18T22:17:43.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29582024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29592024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29602024-12-18T22:17:43.796ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29612024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29622024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29632024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29642024-12-18T22:17:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29652024-12-18T22:17:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29662024-12-18T22:17:43.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29672024-12-18T22:17:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29682024-12-18T22:17:43.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-12-18T22:17:43.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29702024-12-18T22:17:43.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29712024-12-18T22:17:43.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722024-12-18T22:17:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29732024-12-18T22:17:43.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29742024-12-18T22:17:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29752024-12-18T22:17:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29762024-12-18T22:17:43.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29772024-12-18T22:17:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29782024-12-18T22:17:43.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29792024-12-18T22:17:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29802024-12-18T22:17:43.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.130688ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
29812024-12-18T22:17:43.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 427204011 } })
29822024-12-18T22:17:43.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29832024-12-18T22:17:43.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29842024-12-18T22:17:43.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-12-18T22:17:43.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-12-18T22:17:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29872024-12-18T22:17:43.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29882024-12-18T22:17:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29892024-12-18T22:17:43.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29902024-12-18T22:17:43.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29912024-12-18T22:17:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29922024-12-18T22:17:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29932024-12-18T22:17:43.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29942024-12-18T22:17:43.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.405101ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29952024-12-18T22:17:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29962024-12-18T22:17:43.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29972024-12-18T22:17:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29982024-12-18T22:17:43.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 22.171345ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29992024-12-18T22:17:43.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 437402212 } })
30002024-12-18T22:17:43.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30012024-12-18T22:17:43.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
30022024-12-18T22:17:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30032024-12-18T22:17:43.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042024-12-18T22:17:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30052024-12-18T22:17:43.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30062024-12-18T22:17:43.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30072024-12-18T22:17:43.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.285529ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
30082024-12-18T22:17:43.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30092024-12-18T22:17:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30102024-12-18T22:17:43.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30112024-12-18T22:17:43.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30122024-12-18T22:17:43.844ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30132024-12-18T22:17:43.844ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30142024-12-18T22:17:43.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30152024-12-18T22:17:43.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30162024-12-18T22:17:43.850ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30172024-12-18T22:17:43.850ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.080759ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30182024-12-18T22:17:43.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192024-12-18T22:17:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30202024-12-18T22:17:43.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30212024-12-18T22:17:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30222024-12-18T22:17:43.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30232024-12-18T22:17:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
30242024-12-18T22:17:43.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30252024-12-18T22:17:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262024-12-18T22:17:43.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf75ad3-fc5a-41a3-bbf8-bdd44b12bf1d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30272024-12-18T22:17:43.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf75ad3-fc5a-41a3-bbf8-bdd44b12bf1d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30282024-12-18T22:17:43.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30292024-12-18T22:17:43.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30302024-12-18T22:17:43.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eff4ec5e-c36c-46e4-98c1-5661098298dd", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30312024-12-18T22:17:43.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30322024-12-18T22:17:43.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30332024-12-18T22:17:43.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30342024-12-18T22:17:43.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30352024-12-18T22:17:43.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
30362024-12-18T22:17:43.932ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30372024-12-18T22:17:43.932ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "323b6803-3352-4f42-9ebd-c89d55d82b92", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30382024-12-18T22:17:43.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30392024-12-18T22:17:43.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
30402024-12-18T22:17:44.011ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30412024-12-18T22:17:44.011ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "07484d2e-6b3a-4446-8b45-d0833405058b", "content-length": "1", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30422024-12-18T22:17:44.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30432024-12-18T22:17:44.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30442024-12-18T22:17:44.022ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30452024-12-18T22:17:44.022ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30462024-12-18T22:17:44.022ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a2f3ab5-367f-485a-bb5b-10612349eba7", "content-length": "26", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30472024-12-18T22:17:44.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30482024-12-18T22:17:44.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30492024-12-18T22:17:44.036ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30502024-12-18T22:17:44.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30512024-12-18T22:17:44.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2f81cb5-b3b8-4a3c-a375-d7e8e93d7ca8", "content-length": "372", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30522024-12-18T22:17:44.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532024-12-18T22:17:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30542024-12-18T22:17:44.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30552024-12-18T22:17:44.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30562024-12-18T22:17:44.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bdf75ad3-fc5a-41a3-bbf8-bdd44b12bf1d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
30572024-12-18T22:17:44.042ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.640638ms iteration = 8 status = null
30582024-12-18T22:17:44.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592024-12-18T22:17:44.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
30602024-12-18T22:17:44.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30612024-12-18T22:17:44.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30622024-12-18T22:17:44.048ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 257.177846ms iteration = 8 status = 0
30632024-12-18T22:17:44.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
30642024-12-18T22:17:44.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 263.261565ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
30652024-12-18T22:17:44.073ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30662024-12-18T22:17:44.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30672024-12-18T22:17:44.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 283.622215ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30682024-12-18T22:17:44.078ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30692024-12-18T22:17:44.078ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30702024-12-18T22:17:44.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 286.702225ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30712024-12-18T22:17:44.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 288.593552ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30722024-12-18T22:17:44.085ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.029999ms iteration = 8 status = {}
30732024-12-18T22:17:44.090ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30742024-12-18T22:17:44.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30752024-12-18T22:17:44.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "652b5a7d-b2c9-4ea0-a528-d90070975519", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30762024-12-18T22:17:44.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30772024-12-18T22:17:44.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30782024-12-18T22:17:44.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30792024-12-18T22:17:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30802024-12-18T22:17:44.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30812024-12-18T22:17:44.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30822024-12-18T22:17:44.100ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30832024-12-18T22:17:44.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30842024-12-18T22:17:44.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5b5b0a3a-9861-4746-a289-d4682269b19c", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
30852024-12-18T22:17:44.101ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 310.319048ms iteration = 8 status = {}
30862024-12-18T22:17:44.119ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
30872024-12-18T22:17:44.119ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
30882024-12-18T22:17:44.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30892024-12-18T22:17:44.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30902024-12-18T22:17:44.138ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 347.258744ms iteration = 10 status = {"physical_disks_added":0}
30912024-12-18T22:17:44.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922024-12-18T22:17:44.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30932024-12-18T22:17:44.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30942024-12-18T22:17:44.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30952024-12-18T22:17:44.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30962024-12-18T22:17:44.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30972024-12-18T22:17:44.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30982024-12-18T22:17:44.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30992024-12-18T22:17:44.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31002024-12-18T22:17:44.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31012024-12-18T22:17:44.149ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
31022024-12-18T22:17:44.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31032024-12-18T22:17:44.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31042024-12-18T22:17:44.160ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31052024-12-18T22:17:44.160ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "abebd90b-fb73-48f2-8749-9d0eafaccd4e", "content-length": "134", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
31062024-12-18T22:17:44.160ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31072024-12-18T22:17:44.160ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
31082024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31092024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31102024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31112024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31122024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31132024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31142024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31152024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31162024-12-18T22:17:44.161ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
31172024-12-18T22:17:44.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182024-12-18T22:17:44.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192024-12-18T22:17:44.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31202024-12-18T22:17:44.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00ceadbd-b8c7-414e-baa3-b812d77c3928", "content-length": "2", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
31212024-12-18T22:17:44.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31222024-12-18T22:17:44.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2e1a06e-68ad-4269-86d1-5158f230de7b", "content-length": "52", "date": "Wed, 18 Dec 2024 22:17:43 GMT"} })
31232024-12-18T22:17:44.163ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
31242024-12-18T22:17:44.163ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31252024-12-18T22:17:44.167ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31262024-12-18T22:17:44.167ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57219
31272024-12-18T22:17:44.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57219 req_id = 1ca6952e-75f1-44e7-a6c5-3de0872b0661 roles = RoleSet { roles: {} } uri = /metrics/producers
31282024-12-18T22:17:44.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57219 req_id = 1ca6952e-75f1-44e7-a6c5-3de0872b0661 resource = Database result = Ok(()) uri = /metrics/producers
31292024-12-18T22:17:44.182ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31302024-12-18T22:17:44.206ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
31312024-12-18T22:17:44.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39170 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57219 req_id = 1ca6952e-75f1-44e7-a6c5-3de0872b0661 response_code = 201 uri = /metrics/producers
31322024-12-18T22:17:44.206ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "1ca6952e-75f1-44e7-a6c5-3de0872b0661", "content-length": "41", "date": "Wed, 18 Dec 2024 22:17:44 GMT"} })
31332024-12-18T22:17:44.208ZDEBGnexus (producer-registration-task): registered with nexus successfully
31342024-12-18T22:17:44.208ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31352024-12-18T22:17:44.263ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e10e8bfd-8c1d-4583-8fde-36874ff27b6f", "date": "Wed, 18 Dec 2024 22:17:44 GMT"} })
31362024-12-18T22:17:44.263ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
31372024-12-18T22:17:44.263ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31382024-12-18T22:17:44.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b035790-c792-420c-ad37-9b64a8d61dad", "content-length": "691", "date": "Wed, 18 Dec 2024 22:17:44 GMT"} })
31392024-12-18T22:17:44.264ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31402024-12-18T22:17:44.264ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31412024-12-18T22:17:44.264ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31422024-12-18T22:17:44.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f98f652-ef2d-4feb-abcc-9d94406bfe0b", "content-length": "682", "date": "Wed, 18 Dec 2024 22:17:44 GMT"} })
31432024-12-18T22:17:44.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31442024-12-18T22:17:44.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31452024-12-18T22:17:44.265ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.185443ms iteration = 8 status = {}
31462024-12-18T22:17:44.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31472024-12-18T22:17:44.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31482024-12-18T22:17:44.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31492024-12-18T22:17:44.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31502024-12-18T22:17:44.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31512024-12-18T22:17:44.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31522024-12-18T22:17:44.381ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.356663ms iteration = 8 status = {}
31532024-12-18T22:17:45.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a41ffa1-2399-4e66-9e27-e73385f87cf5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31542024-12-18T22:17:45.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a41ffa1-2399-4e66-9e27-e73385f87cf5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31552024-12-18T22:17:45.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5a41ffa1-2399-4e66-9e27-e73385f87cf5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31562024-12-18T22:17:46.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0485bbc9-074f-480c-804d-6e9c58d30749 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31572024-12-18T22:17:46.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0485bbc9-074f-480c-804d-6e9c58d30749 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31582024-12-18T22:17:46.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0485bbc9-074f-480c-804d-6e9c58d30749 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31592024-12-18T22:17:46.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 604 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = acd35c11-6a07-4763-869d-f5b7757d1a1b response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
31602024-12-18T22:17:47.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 839286c5-af5e-49e4-b394-e042664a7ab6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31612024-12-18T22:17:47.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 839286c5-af5e-49e4-b394-e042664a7ab6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31622024-12-18T22:17:47.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 839286c5-af5e-49e4-b394-e042664a7ab6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31632024-12-18T22:17:48.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9710e911-9c10-4570-a1ad-51788fb02f74 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31642024-12-18T22:17:48.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9710e911-9c10-4570-a1ad-51788fb02f74 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31652024-12-18T22:17:48.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9710e911-9c10-4570-a1ad-51788fb02f74 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31662024-12-18T22:17:49.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4e44e4f4-5ba1-4491-b4d7-a58ef219e99a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31672024-12-18T22:17:49.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4e44e4f4-5ba1-4491-b4d7-a58ef219e99a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31682024-12-18T22:17:49.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4e44e4f4-5ba1-4491-b4d7-a58ef219e99a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31692024-12-18T22:17:50.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bb6f34f-2dd0-4145-8a85-1bb5fb814747 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31702024-12-18T22:17:50.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bb6f34f-2dd0-4145-8a85-1bb5fb814747 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31712024-12-18T22:17:50.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bb6f34f-2dd0-4145-8a85-1bb5fb814747 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31722024-12-18T22:17:51.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b37108b1-d231-4bb1-b5aa-d3d4a4de57e1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31732024-12-18T22:17:51.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b37108b1-d231-4bb1-b5aa-d3d4a4de57e1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31742024-12-18T22:17:51.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b37108b1-d231-4bb1-b5aa-d3d4a4de57e1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31752024-12-18T22:17:52.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a572e677-1116-49aa-a81a-665047c809b2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31762024-12-18T22:17:52.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a572e677-1116-49aa-a81a-665047c809b2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31772024-12-18T22:17:52.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a572e677-1116-49aa-a81a-665047c809b2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31782024-12-18T22:17:53.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fddfbbfb-9619-4569-a990-065117e4c084 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31792024-12-18T22:17:53.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fddfbbfb-9619-4569-a990-065117e4c084 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31802024-12-18T22:17:53.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fddfbbfb-9619-4569-a990-065117e4c084 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
31812024-12-18T22:17:53.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
31822024-12-18T22:17:53.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
31832024-12-18T22:17:53.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31842024-12-18T22:17:53.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31852024-12-18T22:17:53.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31862024-12-18T22:17:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31872024-12-18T22:17:53.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31882024-12-18T22:17:53.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31892024-12-18T22:17:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31902024-12-18T22:17:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31912024-12-18T22:17:53.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31922024-12-18T22:17:53.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.701302ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31932024-12-18T22:17:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31942024-12-18T22:17:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31952024-12-18T22:17:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31962024-12-18T22:17:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31972024-12-18T22:17:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
31982024-12-18T22:17:53.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31992024-12-18T22:17:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32002024-12-18T22:17:53.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
32012024-12-18T22:17:53.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.87492ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
32022024-12-18T22:17:54.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 84572087-637c-429e-9a72-d3c6452855b3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32032024-12-18T22:17:54.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 84572087-637c-429e-9a72-d3c6452855b3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32042024-12-18T22:17:54.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 84572087-637c-429e-9a72-d3c6452855b3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32052024-12-18T22:17:55.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 528c11c6-cea4-4d19-8535-88a772037dd5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32062024-12-18T22:17:55.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 528c11c6-cea4-4d19-8535-88a772037dd5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32072024-12-18T22:17:55.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 528c11c6-cea4-4d19-8535-88a772037dd5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32082024-12-18T22:17:56.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70881e8-55ea-4bcb-8fff-0e7114ddb9b4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32092024-12-18T22:17:56.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70881e8-55ea-4bcb-8fff-0e7114ddb9b4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32102024-12-18T22:17:56.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70881e8-55ea-4bcb-8fff-0e7114ddb9b4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32112024-12-18T22:17:56.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 5571713f-4879-4289-9031-b1f07774cab0 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
32122024-12-18T22:17:56.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 5571713f-4879-4289-9031-b1f07774cab0 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
32132024-12-18T22:17:56.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 5571713f-4879-4289-9031-b1f07774cab0 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
32142024-12-18T22:17:56.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = e6f19847-c84d-4e8b-b65e-7c32eb926839 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
32152024-12-18T22:17:56.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = e6f19847-c84d-4e8b-b65e-7c32eb926839 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
32162024-12-18T22:17:56.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = e6f19847-c84d-4e8b-b65e-7c32eb926839 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
32172024-12-18T22:17:56.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = e5c6c56c-b398-4924-afa3-16b292902138 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
32182024-12-18T22:17:57.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4242f7c-62c7-4d9f-8842-844abfe86e5c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32192024-12-18T22:17:57.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4242f7c-62c7-4d9f-8842-844abfe86e5c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32202024-12-18T22:17:57.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4242f7c-62c7-4d9f-8842-844abfe86e5c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32212024-12-18T22:17:58.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f748b19-e881-4904-a871-4b5ed53d38ea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32222024-12-18T22:17:58.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f748b19-e881-4904-a871-4b5ed53d38ea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32232024-12-18T22:17:58.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f748b19-e881-4904-a871-4b5ed53d38ea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32242024-12-18T22:17:59.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ce2d6abe-0045-48c1-aa30-20a4e24160ed roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32252024-12-18T22:17:59.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ce2d6abe-0045-48c1-aa30-20a4e24160ed resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32262024-12-18T22:17:59.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ce2d6abe-0045-48c1-aa30-20a4e24160ed response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32272024-12-18T22:18:00.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e80cb76-f578-4751-b861-236cdc9b6dd0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32282024-12-18T22:18:00.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e80cb76-f578-4751-b861-236cdc9b6dd0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32292024-12-18T22:18:00.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e80cb76-f578-4751-b861-236cdc9b6dd0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32302024-12-18T22:18:01.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 976284e0-66f0-4ffb-9f5e-3de5f43ed3d7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32312024-12-18T22:18:01.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 976284e0-66f0-4ffb-9f5e-3de5f43ed3d7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32322024-12-18T22:18:01.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 976284e0-66f0-4ffb-9f5e-3de5f43ed3d7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32332024-12-18T22:18:02.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2ea0300-c5ba-4734-9c89-d07a29a6881e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32342024-12-18T22:18:02.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2ea0300-c5ba-4734-9c89-d07a29a6881e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32352024-12-18T22:18:02.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e2ea0300-c5ba-4734-9c89-d07a29a6881e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32362024-12-18T22:18:03.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9461d3bb-de2a-4bf8-be7c-8f0a571de6f4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32372024-12-18T22:18:03.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9461d3bb-de2a-4bf8-be7c-8f0a571de6f4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32382024-12-18T22:18:03.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9461d3bb-de2a-4bf8-be7c-8f0a571de6f4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32392024-12-18T22:18:03.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
32402024-12-18T22:18:03.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
32412024-12-18T22:18:03.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32422024-12-18T22:18:03.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32432024-12-18T22:18:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32442024-12-18T22:18:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32452024-12-18T22:18:03.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462024-12-18T22:18:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32472024-12-18T22:18:03.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32482024-12-18T22:18:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32492024-12-18T22:18:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32502024-12-18T22:18:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32512024-12-18T22:18:03.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-12-18T22:18:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
32532024-12-18T22:18:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32542024-12-18T22:18:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32552024-12-18T22:18:03.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
32562024-12-18T22:18:03.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.097173ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
32572024-12-18T22:18:03.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32582024-12-18T22:18:03.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32592024-12-18T22:18:03.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.440107ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32602024-12-18T22:18:04.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a44f7c39-91a3-4fd4-84cc-2b2a7b023f05 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32612024-12-18T22:18:04.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a44f7c39-91a3-4fd4-84cc-2b2a7b023f05 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32622024-12-18T22:18:04.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a44f7c39-91a3-4fd4-84cc-2b2a7b023f05 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32632024-12-18T22:18:05.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fbb2c522-25cd-412c-9cbc-a907c2b7bddf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32642024-12-18T22:18:05.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fbb2c522-25cd-412c-9cbc-a907c2b7bddf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32652024-12-18T22:18:05.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fbb2c522-25cd-412c-9cbc-a907c2b7bddf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32662024-12-18T22:18:06.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87304811-c2a8-4230-b871-dfdec41131ac roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32672024-12-18T22:18:06.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87304811-c2a8-4230-b871-dfdec41131ac resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32682024-12-18T22:18:06.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87304811-c2a8-4230-b871-dfdec41131ac response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32692024-12-18T22:18:06.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 471 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 12ff6089-0226-4699-b263-83f9a7c4e821 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
32702024-12-18T22:18:07.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 852f99aa-7455-4573-94be-7602db4c30c3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32712024-12-18T22:18:07.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 852f99aa-7455-4573-94be-7602db4c30c3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32722024-12-18T22:18:07.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 852f99aa-7455-4573-94be-7602db4c30c3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32732024-12-18T22:18:08.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f59ad4a2-863c-4cf6-823e-0fe844cd33d4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32742024-12-18T22:18:08.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f59ad4a2-863c-4cf6-823e-0fe844cd33d4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32752024-12-18T22:18:08.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f59ad4a2-863c-4cf6-823e-0fe844cd33d4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32762024-12-18T22:18:09.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a147711-82f3-4c68-99f2-7395b6f28b34 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32772024-12-18T22:18:09.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a147711-82f3-4c68-99f2-7395b6f28b34 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32782024-12-18T22:18:09.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a147711-82f3-4c68-99f2-7395b6f28b34 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32792024-12-18T22:18:10.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ed6e5bc-7222-43dc-914c-cdef07ae8a41 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32802024-12-18T22:18:10.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ed6e5bc-7222-43dc-914c-cdef07ae8a41 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32812024-12-18T22:18:10.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4ed6e5bc-7222-43dc-914c-cdef07ae8a41 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32822024-12-18T22:18:11.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45f9db2d-8f9c-45be-9516-71dd9ece5e11 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32832024-12-18T22:18:11.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45f9db2d-8f9c-45be-9516-71dd9ece5e11 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32842024-12-18T22:18:11.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45f9db2d-8f9c-45be-9516-71dd9ece5e11 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32852024-12-18T22:18:12.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 77d828c3-946d-4f71-93d2-0e6e8ff7654b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32862024-12-18T22:18:12.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 77d828c3-946d-4f71-93d2-0e6e8ff7654b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32872024-12-18T22:18:12.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 77d828c3-946d-4f71-93d2-0e6e8ff7654b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32882024-12-18T22:18:13.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 170996c2-2fd4-40fc-ab11-1d38bb5ff529 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32892024-12-18T22:18:13.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 170996c2-2fd4-40fc-ab11-1d38bb5ff529 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32902024-12-18T22:18:13.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 170996c2-2fd4-40fc-ab11-1d38bb5ff529 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32912024-12-18T22:18:13.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0abf4592-ad4a-485c-95e3-4c91ee2ae06a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32922024-12-18T22:18:13.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0abf4592-ad4a-485c-95e3-4c91ee2ae06a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32932024-12-18T22:18:13.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0abf4592-ad4a-485c-95e3-4c91ee2ae06a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
32942024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
32952024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
32962024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32972024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32982024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
32992024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
33002024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
33012024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33022024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
33032024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33042024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
33052024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33062024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33072024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
33082024-12-18T22:18:13.791ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33092024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33102024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
33112024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33122024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
33132024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33142024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
33152024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33162024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
33172024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33182024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
33192024-12-18T22:18:13.791ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:08:13.791659049 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33202024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
33212024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33222024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33232024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
33242024-12-18T22:18:13.791ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
33252024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.81\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
33262024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
33272024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
33282024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33292024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
33302024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33312024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
33322024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
33332024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33342024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33352024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
33362024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33372024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
33382024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33392024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33402024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
33412024-12-18T22:18:13.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33422024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
33432024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33442024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33452024-12-18T22:18:13.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
33462024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33472024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
33482024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33492024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33502024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
33512024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33522024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
33532024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33542024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33552024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
33562024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
33572024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33582024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33592024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33602024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33612024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33622024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33632024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33642024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33652024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33662024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33672024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33682024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33692024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33702024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33712024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33722024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33732024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33742024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33752024-12-18T22:18:13.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 415660475 } })
33762024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33772024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33782024-12-18T22:18:13.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 415696516 } })
33792024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33802024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33812024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33822024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
33832024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.179123ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
33842024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33852024-12-18T22:18:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.363866ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33862024-12-18T22:18:13.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33872024-12-18T22:18:13.794ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.141042ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33882024-12-18T22:18:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33892024-12-18T22:18:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33902024-12-18T22:18:13.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 418674464 } })
33912024-12-18T22:18:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33922024-12-18T22:18:13.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-12-18T22:18:13.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33942024-12-18T22:18:13.796ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952024-12-18T22:18:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33962024-12-18T22:18:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33972024-12-18T22:18:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33982024-12-18T22:18:13.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33992024-12-18T22:18:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34002024-12-18T22:18:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34012024-12-18T22:18:13.798ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34022024-12-18T22:18:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34032024-12-18T22:18:13.800ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:08:13.791659049 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34042024-12-18T22:18:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.835543ms iteration = 5 status = {"expiration":"2024-12-18T22:08:13.791659049Z","pruned":[]}
34052024-12-18T22:18:13.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34062024-12-18T22:18:13.800ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34072024-12-18T22:18:13.800ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34082024-12-18T22:18:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.257342ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34092024-12-18T22:18:13.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102024-12-18T22:18:13.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112024-12-18T22:18:13.803ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.451425ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
34122024-12-18T22:18:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34132024-12-18T22:18:13.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34142024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34152024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34162024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34172024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34182024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34192024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34202024-12-18T22:18:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34212024-12-18T22:18:13.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34222024-12-18T22:18:13.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 430898384 } })
34232024-12-18T22:18:13.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
34242024-12-18T22:18:13.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34252024-12-18T22:18:13.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34262024-12-18T22:18:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34272024-12-18T22:18:13.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-12-18T22:18:13.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 436483823 } })
34292024-12-18T22:18:13.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
34302024-12-18T22:18:13.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34312024-12-18T22:18:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34322024-12-18T22:18:13.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34332024-12-18T22:18:13.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34342024-12-18T22:18:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34352024-12-18T22:18:13.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34362024-12-18T22:18:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34372024-12-18T22:18:13.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.940933ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
34382024-12-18T22:18:13.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34392024-12-18T22:18:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34402024-12-18T22:18:13.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34412024-12-18T22:18:13.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34422024-12-18T22:18:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34432024-12-18T22:18:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34442024-12-18T22:18:13.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34452024-12-18T22:18:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34462024-12-18T22:18:13.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 52.514261ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34472024-12-18T22:18:13.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34482024-12-18T22:18:13.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.691793ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
34492024-12-18T22:18:13.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34502024-12-18T22:18:13.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.501098ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34512024-12-18T22:18:13.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-12-18T22:18:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34532024-12-18T22:18:13.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34542024-12-18T22:18:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34552024-12-18T22:18:13.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34562024-12-18T22:18:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34572024-12-18T22:18:13.854ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34582024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34592024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34602024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34612024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34622024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34632024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34652024-12-18T22:18:13.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.727411ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34662024-12-18T22:18:13.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34672024-12-18T22:18:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34682024-12-18T22:18:13.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692024-12-18T22:18:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34702024-12-18T22:18:13.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34712024-12-18T22:18:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34722024-12-18T22:18:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34732024-12-18T22:18:13.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34742024-12-18T22:18:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34752024-12-18T22:18:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34762024-12-18T22:18:13.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34772024-12-18T22:18:13.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.522964ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34782024-12-18T22:18:13.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34792024-12-18T22:18:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802024-12-18T22:18:13.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812024-12-18T22:18:13.863ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34822024-12-18T22:18:13.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.209176ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34832024-12-18T22:18:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34842024-12-18T22:18:13.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34852024-12-18T22:18:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34862024-12-18T22:18:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
34872024-12-18T22:18:13.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34882024-12-18T22:18:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34892024-12-18T22:18:13.866ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34902024-12-18T22:18:13.866ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34912024-12-18T22:18:13.866ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.701885ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34922024-12-18T22:18:13.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-12-18T22:18:13.867ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.628044ms iteration = 9 status = 0
34942024-12-18T22:18:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
34952024-12-18T22:18:13.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34962024-12-18T22:18:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34972024-12-18T22:18:13.880ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
34982024-12-18T22:18:13.880ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.641249ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
34992024-12-18T22:18:13.884ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35002024-12-18T22:18:13.884ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35012024-12-18T22:18:13.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35022024-12-18T22:18:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35032024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35042024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35052024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35062024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35072024-12-18T22:18:13.887ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35082024-12-18T22:18:13.887ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35092024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.412682ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35102024-12-18T22:18:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35112024-12-18T22:18:13.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35122024-12-18T22:18:13.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35132024-12-18T22:18:13.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35142024-12-18T22:18:13.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35152024-12-18T22:18:13.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35162024-12-18T22:18:13.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35172024-12-18T22:18:13.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35182024-12-18T22:18:13.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35192024-12-18T22:18:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35202024-12-18T22:18:13.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35212024-12-18T22:18:13.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35222024-12-18T22:18:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35232024-12-18T22:18:13.896ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35242024-12-18T22:18:13.896ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35252024-12-18T22:18:13.896ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35262024-12-18T22:18:13.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35272024-12-18T22:18:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35282024-12-18T22:18:13.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35292024-12-18T22:18:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35302024-12-18T22:18:13.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35312024-12-18T22:18:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35322024-12-18T22:18:13.902ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35332024-12-18T22:18:13.902ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
35342024-12-18T22:18:13.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35352024-12-18T22:18:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35362024-12-18T22:18:13.925ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35372024-12-18T22:18:13.930ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35382024-12-18T22:18:13.930ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35392024-12-18T22:18:13.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35402024-12-18T22:18:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35412024-12-18T22:18:13.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35422024-12-18T22:18:13.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35432024-12-18T22:18:13.933ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35442024-12-18T22:18:13.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452024-12-18T22:18:13.933ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51640d2-7ff4-4355-859d-42abb8b8a4e4", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
35462024-12-18T22:18:13.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35472024-12-18T22:18:13.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35482024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35492024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35502024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35512024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35522024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35532024-12-18T22:18:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35542024-12-18T22:18:13.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35552024-12-18T22:18:13.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35562024-12-18T22:18:13.938ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35572024-12-18T22:18:13.938ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35582024-12-18T22:18:13.938ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
35592024-12-18T22:18:13.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.003134ms iteration = 5 status = {"generation":1}
35602024-12-18T22:18:13.959ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.006187ms iteration = 11 status = {"physical_disks_added":0}
35612024-12-18T22:18:13.977ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35622024-12-18T22:18:13.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 185.296696ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35632024-12-18T22:18:14.021ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35642024-12-18T22:18:14.038ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
35652024-12-18T22:18:14.038ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 246.458825ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35662024-12-18T22:18:14.053ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35672024-12-18T22:18:14.053ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35682024-12-18T22:18:14.053ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f1ab4f-b090-41d7-9a6f-bf543d1e736f", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
35692024-12-18T22:18:14.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35702024-12-18T22:18:14.054ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35712024-12-18T22:18:14.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35722024-12-18T22:18:14.113ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.703462ms iteration = 9 status = {}
35732024-12-18T22:18:14.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
35742024-12-18T22:18:14.133ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35752024-12-18T22:18:14.133ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94d37c23-3cc7-4527-8c75-fe250218df3b", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
35762024-12-18T22:18:14.133ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35772024-12-18T22:18:14.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
35782024-12-18T22:18:14.135ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35792024-12-18T22:18:14.135ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35802024-12-18T22:18:14.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ac013c2-fb67-4c1c-9abd-69881492952f", "content-length": "372", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
35812024-12-18T22:18:14.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35822024-12-18T22:18:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35832024-12-18T22:18:14.138ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
35842024-12-18T22:18:14.138ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35852024-12-18T22:18:14.138ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
35862024-12-18T22:18:14.138ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 346.682252ms iteration = 5 status = {"generation":2}
35872024-12-18T22:18:14.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35882024-12-18T22:18:14.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35892024-12-18T22:18:14.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902024-12-18T22:18:14.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35912024-12-18T22:18:14.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35922024-12-18T22:18:14.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35932024-12-18T22:18:14.176ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35942024-12-18T22:18:14.176ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35952024-12-18T22:18:14.176ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "728d54f5-d8a8-44d8-8ba2-b8a7d0cd538f", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
35962024-12-18T22:18:14.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35972024-12-18T22:18:14.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35982024-12-18T22:18:14.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992024-12-18T22:18:14.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36002024-12-18T22:18:14.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36012024-12-18T22:18:14.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36022024-12-18T22:18:14.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36032024-12-18T22:18:14.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36042024-12-18T22:18:14.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36052024-12-18T22:18:14.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36062024-12-18T22:18:14.186ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36072024-12-18T22:18:14.186ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36082024-12-18T22:18:14.187ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "92b1ad57-166e-483c-8ddb-6a4b229af524", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
36092024-12-18T22:18:14.187ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36102024-12-18T22:18:14.188ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec491b15-3672-4be9-bef6-86572bd8c027", "content-length": "1", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
36112024-12-18T22:18:14.188ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 396.745934ms iteration = 9 status = {}
36122024-12-18T22:18:14.189ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36132024-12-18T22:18:14.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36142024-12-18T22:18:14.191ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.694432ms iteration = 9 status = null
36152024-12-18T22:18:14.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36162024-12-18T22:18:14.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4434ba34-fdf1-42c2-a1a0-939ed7f92b62", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36172024-12-18T22:18:14.205ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36182024-12-18T22:18:14.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dcbea9d4-f547-406a-a51a-cd2af36b922c", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36192024-12-18T22:18:14.207ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36202024-12-18T22:18:14.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36212024-12-18T22:18:14.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 417.688455ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36222024-12-18T22:18:14.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36232024-12-18T22:18:14.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "89914121-0619-4a4f-83b6-f585e00a23b3", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36242024-12-18T22:18:14.212ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36252024-12-18T22:18:14.214ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "56d0ab45-35f4-4985-ac36-da6f2c8d57a4", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36262024-12-18T22:18:14.214ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36272024-12-18T22:18:14.216ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "18cbd9f0-1f3a-4740-8a5d-1a56940610ef", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36282024-12-18T22:18:14.216ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36292024-12-18T22:18:14.217ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36302024-12-18T22:18:14.218ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 426.506248ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36312024-12-18T22:18:14.294ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36322024-12-18T22:18:14.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "de5026b9-0e37-4a2f-8c16-0e10f42acf1e", "content-length": "691", "date": "Wed, 18 Dec 2024 22:18:13 GMT"} })
36332024-12-18T22:18:14.294ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36342024-12-18T22:18:14.294ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36352024-12-18T22:18:14.294ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36362024-12-18T22:18:14.296ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.58565ms iteration = 9 status = {}
36372024-12-18T22:18:14.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36382024-12-18T22:18:14.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36392024-12-18T22:18:14.311ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
36402024-12-18T22:18:14.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36412024-12-18T22:18:14.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36422024-12-18T22:18:14.321ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36432024-12-18T22:18:14.321ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cdc6525-5ad9-4d68-98bb-e2cd21278805", "content-length": "134", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} })
36442024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36452024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
36462024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36472024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36482024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36492024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36502024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36512024-12-18T22:18:14.321ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36522024-12-18T22:18:14.322ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36532024-12-18T22:18:14.322ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36542024-12-18T22:18:14.322ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
36552024-12-18T22:18:14.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36562024-12-18T22:18:14.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36572024-12-18T22:18:14.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36582024-12-18T22:18:14.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c611aa7e-e221-48e6-840c-3c64cb35d39d", "content-length": "2", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} })
36592024-12-18T22:18:14.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36602024-12-18T22:18:14.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "010f4586-61c5-406d-8169-e45edf33576d", "content-length": "52", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} })
36612024-12-18T22:18:14.324ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
36622024-12-18T22:18:14.324ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36632024-12-18T22:18:14.420ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7eb6c92f-85b5-41c5-8aad-3434474a9b57", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} })
36642024-12-18T22:18:14.420ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
36652024-12-18T22:18:14.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36662024-12-18T22:18:14.420ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "da619bf0-0757-4e52-b211-f2128322fe4f", "content-length": "682", "date": "Wed, 18 Dec 2024 22:18:14 GMT"} })
36672024-12-18T22:18:14.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36682024-12-18T22:18:14.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36692024-12-18T22:18:14.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36702024-12-18T22:18:14.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36712024-12-18T22:18:14.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36722024-12-18T22:18:14.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36732024-12-18T22:18:14.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36742024-12-18T22:18:14.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36752024-12-18T22:18:14.436ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.144158ms iteration = 9 status = {}
36762024-12-18T22:18:14.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 731f5107-5a5a-49c3-9856-5f7bb96cf4f1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36772024-12-18T22:18:14.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 731f5107-5a5a-49c3-9856-5f7bb96cf4f1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36782024-12-18T22:18:14.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 731f5107-5a5a-49c3-9856-5f7bb96cf4f1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36792024-12-18T22:18:15.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c4b89e5-e3a2-4d3a-8343-a4b6dfe6fdb5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36802024-12-18T22:18:15.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c4b89e5-e3a2-4d3a-8343-a4b6dfe6fdb5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36812024-12-18T22:18:15.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c4b89e5-e3a2-4d3a-8343-a4b6dfe6fdb5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36822024-12-18T22:18:16.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 0c39614b-83d3-464a-a48a-dbcfce7de120 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
36832024-12-18T22:18:16.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 115018f7-9a1d-40ba-927d-b08f60701c62 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36842024-12-18T22:18:16.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 115018f7-9a1d-40ba-927d-b08f60701c62 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36852024-12-18T22:18:16.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 115018f7-9a1d-40ba-927d-b08f60701c62 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36862024-12-18T22:18:17.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b83e4423-1016-44e7-96f4-fb44f26cc16e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36872024-12-18T22:18:17.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b83e4423-1016-44e7-96f4-fb44f26cc16e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36882024-12-18T22:18:17.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b83e4423-1016-44e7-96f4-fb44f26cc16e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36892024-12-18T22:18:18.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9a256bc-6840-4812-aa5b-88ed50e91d87 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36902024-12-18T22:18:18.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9a256bc-6840-4812-aa5b-88ed50e91d87 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36912024-12-18T22:18:18.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d9a256bc-6840-4812-aa5b-88ed50e91d87 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36922024-12-18T22:18:19.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81fee24b-6ec1-454b-bc5f-0c303ab6ca64 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36932024-12-18T22:18:19.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81fee24b-6ec1-454b-bc5f-0c303ab6ca64 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36942024-12-18T22:18:19.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81fee24b-6ec1-454b-bc5f-0c303ab6ca64 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36952024-12-18T22:18:20.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082fde57-c75b-4e7e-88be-9f69088d45fc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36962024-12-18T22:18:20.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082fde57-c75b-4e7e-88be-9f69088d45fc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36972024-12-18T22:18:20.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082fde57-c75b-4e7e-88be-9f69088d45fc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36982024-12-18T22:18:21.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f23843-6d35-4e2f-9198-0c6276c9e4b0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
36992024-12-18T22:18:21.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f23843-6d35-4e2f-9198-0c6276c9e4b0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37002024-12-18T22:18:21.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7f23843-6d35-4e2f-9198-0c6276c9e4b0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37012024-12-18T22:18:22.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73f5750e-d7d8-4417-bc07-5362ee31e78b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37022024-12-18T22:18:22.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73f5750e-d7d8-4417-bc07-5362ee31e78b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37032024-12-18T22:18:22.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73f5750e-d7d8-4417-bc07-5362ee31e78b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37042024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
37052024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37062024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
37072024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37082024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37092024-12-18T22:18:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37102024-12-18T22:18:23.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37112024-12-18T22:18:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37122024-12-18T22:18:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37132024-12-18T22:18:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37142024-12-18T22:18:23.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37152024-12-18T22:18:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37162024-12-18T22:18:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-12-18T22:18:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
37182024-12-18T22:18:23.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192024-12-18T22:18:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37202024-12-18T22:18:23.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
37212024-12-18T22:18:23.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.924899ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
37222024-12-18T22:18:23.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37232024-12-18T22:18:23.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37242024-12-18T22:18:23.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.943445ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37252024-12-18T22:18:23.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b0c3287f-7dff-4120-ba06-e89eedacee62 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37262024-12-18T22:18:23.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b0c3287f-7dff-4120-ba06-e89eedacee62 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37272024-12-18T22:18:23.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b0c3287f-7dff-4120-ba06-e89eedacee62 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37282024-12-18T22:18:24.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa4445fb-cddc-43d2-b0f8-02eae6ba0606 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37292024-12-18T22:18:24.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa4445fb-cddc-43d2-b0f8-02eae6ba0606 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37302024-12-18T22:18:24.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa4445fb-cddc-43d2-b0f8-02eae6ba0606 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37312024-12-18T22:18:25.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 40c7d6c5-37cf-4ca7-b07d-281ef949f910 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37322024-12-18T22:18:25.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 40c7d6c5-37cf-4ca7-b07d-281ef949f910 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37332024-12-18T22:18:25.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 40c7d6c5-37cf-4ca7-b07d-281ef949f910 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37342024-12-18T22:18:26.629ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 99dd5a41-3dde-489c-99f0-97e7e0261107 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
37352024-12-18T22:18:26.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e7a4958-55e7-44b6-8ae0-ca07f2bcb959 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37362024-12-18T22:18:26.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e7a4958-55e7-44b6-8ae0-ca07f2bcb959 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37372024-12-18T22:18:26.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5e7a4958-55e7-44b6-8ae0-ca07f2bcb959 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37382024-12-18T22:18:27.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd586058-ddd1-4682-8629-1dc430a14548 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37392024-12-18T22:18:27.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd586058-ddd1-4682-8629-1dc430a14548 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37402024-12-18T22:18:27.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bd586058-ddd1-4682-8629-1dc430a14548 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37412024-12-18T22:18:29.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cfbf6a9-6f15-426b-bcd8-c5648c75268f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37422024-12-18T22:18:29.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cfbf6a9-6f15-426b-bcd8-c5648c75268f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37432024-12-18T22:18:29.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cfbf6a9-6f15-426b-bcd8-c5648c75268f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37442024-12-18T22:18:30.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58784cce-3b3c-4de4-9329-97d7ed3d1dfd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37452024-12-18T22:18:30.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58784cce-3b3c-4de4-9329-97d7ed3d1dfd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37462024-12-18T22:18:30.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58784cce-3b3c-4de4-9329-97d7ed3d1dfd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37472024-12-18T22:18:31.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76b6f2fd-6db2-4a85-9d62-3edfd25b01b1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37482024-12-18T22:18:31.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76b6f2fd-6db2-4a85-9d62-3edfd25b01b1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37492024-12-18T22:18:31.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76b6f2fd-6db2-4a85-9d62-3edfd25b01b1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37502024-12-18T22:18:32.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b7ac208-1faf-4e30-9ec5-9131b64592b8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37512024-12-18T22:18:32.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b7ac208-1faf-4e30-9ec5-9131b64592b8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37522024-12-18T22:18:32.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b7ac208-1faf-4e30-9ec5-9131b64592b8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37532024-12-18T22:18:33.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8af62bc9-922d-4db6-85e5-ad1145ab1f9c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37542024-12-18T22:18:33.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8af62bc9-922d-4db6-85e5-ad1145ab1f9c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37552024-12-18T22:18:33.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8af62bc9-922d-4db6-85e5-ad1145ab1f9c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37562024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
37572024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37582024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
37592024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37602024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37612024-12-18T22:18:33.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37622024-12-18T22:18:33.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632024-12-18T22:18:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37642024-12-18T22:18:33.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37652024-12-18T22:18:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37662024-12-18T22:18:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37672024-12-18T22:18:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37682024-12-18T22:18:33.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37692024-12-18T22:18:33.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37702024-12-18T22:18:33.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712024-12-18T22:18:33.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
37722024-12-18T22:18:33.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732024-12-18T22:18:33.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37742024-12-18T22:18:33.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
37752024-12-18T22:18:33.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.620233ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
37762024-12-18T22:18:33.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.359143ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37772024-12-18T22:18:34.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e4c5940-7821-4c04-b6a3-ff8c9c39836f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37782024-12-18T22:18:34.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e4c5940-7821-4c04-b6a3-ff8c9c39836f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37792024-12-18T22:18:34.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e4c5940-7821-4c04-b6a3-ff8c9c39836f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37802024-12-18T22:18:35.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee538f79-745d-422e-a4b1-50ede1bca526 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37812024-12-18T22:18:35.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee538f79-745d-422e-a4b1-50ede1bca526 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37822024-12-18T22:18:35.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee538f79-745d-422e-a4b1-50ede1bca526 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37832024-12-18T22:18:36.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5eda48c0-8957-4f7c-a434-2bba43a1fe7f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37842024-12-18T22:18:36.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5eda48c0-8957-4f7c-a434-2bba43a1fe7f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37852024-12-18T22:18:36.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5eda48c0-8957-4f7c-a434-2bba43a1fe7f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37862024-12-18T22:18:36.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 765 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 4af90aec-8a59-47c2-82c1-af092ae6c659 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
37872024-12-18T22:18:37.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18fff2ca-d7cc-4fba-b6b3-8143d04da750 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37882024-12-18T22:18:37.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18fff2ca-d7cc-4fba-b6b3-8143d04da750 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37892024-12-18T22:18:37.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18fff2ca-d7cc-4fba-b6b3-8143d04da750 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37902024-12-18T22:18:38.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b65b4f5-a3a9-42d4-a35a-a825f82119ef roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37912024-12-18T22:18:38.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b65b4f5-a3a9-42d4-a35a-a825f82119ef resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37922024-12-18T22:18:38.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6b65b4f5-a3a9-42d4-a35a-a825f82119ef response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37932024-12-18T22:18:39.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5215970a-022e-4814-a8c0-65c3ba3e0256 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37942024-12-18T22:18:39.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5215970a-022e-4814-a8c0-65c3ba3e0256 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37952024-12-18T22:18:39.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5215970a-022e-4814-a8c0-65c3ba3e0256 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37962024-12-18T22:18:40.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0862ebff-3907-4a79-b09a-00f4cf446d71 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37972024-12-18T22:18:40.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0862ebff-3907-4a79-b09a-00f4cf446d71 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37982024-12-18T22:18:40.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0862ebff-3907-4a79-b09a-00f4cf446d71 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
37992024-12-18T22:18:41.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a41b2f2a-e02b-472a-9f89-3daa3054c7e0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38002024-12-18T22:18:41.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a41b2f2a-e02b-472a-9f89-3daa3054c7e0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38012024-12-18T22:18:41.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a41b2f2a-e02b-472a-9f89-3daa3054c7e0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38022024-12-18T22:18:42.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39713e69-0928-4ccf-b645-dd4b368bfdd2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38032024-12-18T22:18:42.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39713e69-0928-4ccf-b645-dd4b368bfdd2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38042024-12-18T22:18:42.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39713e69-0928-4ccf-b645-dd4b368bfdd2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38052024-12-18T22:18:43.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b99c77c9-8f2a-4878-952f-8c7a2cae641b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38062024-12-18T22:18:43.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b99c77c9-8f2a-4878-952f-8c7a2cae641b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38072024-12-18T22:18:43.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b99c77c9-8f2a-4878-952f-8c7a2cae641b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38082024-12-18T22:18:43.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5871a582-8b62-4fd5-9ce9-294ddf1077ff roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38092024-12-18T22:18:43.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5871a582-8b62-4fd5-9ce9-294ddf1077ff resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38102024-12-18T22:18:43.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5871a582-8b62-4fd5-9ce9-294ddf1077ff response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
38112024-12-18T22:18:43.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
38122024-12-18T22:18:43.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38132024-12-18T22:18:43.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
38142024-12-18T22:18:43.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38152024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38162024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
38172024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38182024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
38192024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
38202024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38212024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38222024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
38232024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38242024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
38252024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
38262024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
38272024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38282024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
38292024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
38302024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38312024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38322024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
38332024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38352024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
38362024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38372024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
38382024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38392024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
38402024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38412024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
38422024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38432024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
38442024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38452024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38462024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38472024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38482024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38492024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38502024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38512024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38522024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38532024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38542024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38552024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38562024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38572024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38582024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38592024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38602024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38612024-12-18T22:18:43.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38622024-12-18T22:18:43.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 418146283 } })
38632024-12-18T22:18:43.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38642024-12-18T22:18:43.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
38652024-12-18T22:18:43.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.245623ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38662024-12-18T22:18:43.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672024-12-18T22:18:43.796ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38682024-12-18T22:18:43.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38692024-12-18T22:18:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38702024-12-18T22:18:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38712024-12-18T22:18:43.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38722024-12-18T22:18:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38732024-12-18T22:18:43.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 425166941 } })
38742024-12-18T22:18:43.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-12-18T22:18:43.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
38762024-12-18T22:18:43.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38772024-12-18T22:18:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38782024-12-18T22:18:43.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38792024-12-18T22:18:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38802024-12-18T22:18:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38812024-12-18T22:18:43.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38822024-12-18T22:18:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-12-18T22:18:43.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 432972904 } })
38842024-12-18T22:18:43.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
38852024-12-18T22:18:43.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38862024-12-18T22:18:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38872024-12-18T22:18:43.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38882024-12-18T22:18:43.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38892024-12-18T22:18:43.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38902024-12-18T22:18:43.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-12-18T22:18:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38922024-12-18T22:18:43.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38932024-12-18T22:18:43.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38942024-12-18T22:18:43.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.846569ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
38952024-12-18T22:18:43.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38962024-12-18T22:18:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38972024-12-18T22:18:43.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38982024-12-18T22:18:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38992024-12-18T22:18:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39002024-12-18T22:18:43.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-12-18T22:18:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39022024-12-18T22:18:43.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39032024-12-18T22:18:43.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39042024-12-18T22:18:43.845ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39052024-12-18T22:18:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.264255ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39062024-12-18T22:18:43.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.231894ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
39072024-12-18T22:18:43.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39082024-12-18T22:18:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39092024-12-18T22:18:43.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102024-12-18T22:18:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-12-18T22:18:43.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39122024-12-18T22:18:43.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132024-12-18T22:18:43.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39142024-12-18T22:18:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39152024-12-18T22:18:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39162024-12-18T22:18:43.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39172024-12-18T22:18:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39182024-12-18T22:18:43.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39192024-12-18T22:18:43.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39202024-12-18T22:18:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39212024-12-18T22:18:43.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.69204ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39222024-12-18T22:18:43.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39232024-12-18T22:18:43.856ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39242024-12-18T22:18:43.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39252024-12-18T22:18:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39262024-12-18T22:18:43.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39272024-12-18T22:18:43.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39282024-12-18T22:18:43.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-12-18T22:18:43.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
39302024-12-18T22:18:43.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312024-12-18T22:18:43.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39322024-12-18T22:18:43.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39332024-12-18T22:18:43.873ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39342024-12-18T22:18:43.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39352024-12-18T22:18:43.874ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a904bf49-836b-48fe-9124-0b0d5b1ffea1", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:43 GMT"} })
39362024-12-18T22:18:43.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39372024-12-18T22:18:43.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39382024-12-18T22:18:43.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39392024-12-18T22:18:43.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.170131ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39402024-12-18T22:18:43.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.743021ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39412024-12-18T22:18:43.887ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39422024-12-18T22:18:43.887ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39432024-12-18T22:18:43.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39442024-12-18T22:18:43.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39452024-12-18T22:18:43.887ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.81649ms iteration = 12 status = {"physical_disks_added":0}
39462024-12-18T22:18:43.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39472024-12-18T22:18:43.894ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39482024-12-18T22:18:43.894ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "974d44e9-22e8-42b3-bc06-1c9f3d5b64ae", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:43 GMT"} })
39492024-12-18T22:18:43.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39502024-12-18T22:18:43.896ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39512024-12-18T22:18:43.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
39522024-12-18T22:18:43.913ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39532024-12-18T22:18:43.913ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f306b1aa-8f7e-4bbb-84bf-7f0245c8edb7", "content-length": "26", "date": "Wed, 18 Dec 2024 22:18:43 GMT"} })
39542024-12-18T22:18:43.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39552024-12-18T22:18:43.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
39562024-12-18T22:18:43.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39572024-12-18T22:18:43.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39582024-12-18T22:18:44.001ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39592024-12-18T22:18:44.002ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e37f6678-cb4e-4931-8afa-e79d9d17b769", "content-length": "1", "date": "Wed, 18 Dec 2024 22:18:43 GMT"} })
39602024-12-18T22:18:44.003ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39612024-12-18T22:18:44.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39622024-12-18T22:18:44.040ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39632024-12-18T22:18:44.040ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39642024-12-18T22:18:44.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc137f45-a7cd-4a0b-a9b6-cc54308bf36d", "content-length": "372", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
39652024-12-18T22:18:44.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39662024-12-18T22:18:44.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39672024-12-18T22:18:44.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 250.072126ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39682024-12-18T22:18:44.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692024-12-18T22:18:44.043ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39702024-12-18T22:18:44.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712024-12-18T22:18:44.044ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.068115ms iteration = 10 status = null
39722024-12-18T22:18:44.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39732024-12-18T22:18:44.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39742024-12-18T22:18:44.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39752024-12-18T22:18:44.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39762024-12-18T22:18:44.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39772024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
39782024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39792024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39802024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39812024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39822024-12-18T22:18:44.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39832024-12-18T22:18:44.050ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 257.987212ms iteration = 10 status = 0
39842024-12-18T22:18:44.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
39852024-12-18T22:18:44.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 262.036012ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
39862024-12-18T22:18:44.068ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 276.413503ms iteration = 10 status = {}
39872024-12-18T22:18:44.071ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39882024-12-18T22:18:44.071ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39892024-12-18T22:18:44.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 279.438333ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39902024-12-18T22:18:44.080ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
39912024-12-18T22:18:44.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39922024-12-18T22:18:44.081ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5395f434-804e-4e29-b96b-5252a24a8c43", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
39932024-12-18T22:18:44.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39942024-12-18T22:18:44.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39952024-12-18T22:18:44.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39962024-12-18T22:18:44.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39972024-12-18T22:18:44.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39982024-12-18T22:18:44.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39992024-12-18T22:18:44.090ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40002024-12-18T22:18:44.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40012024-12-18T22:18:44.091ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ec333b4b-1515-4448-86ca-96950b73391a", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40022024-12-18T22:18:44.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.577708ms iteration = 10 status = {}
40032024-12-18T22:18:44.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40042024-12-18T22:18:44.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba91ab85-dceb-49f3-bc4e-fd1dfeaaebde", "content-length": "691", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40052024-12-18T22:18:44.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40062024-12-18T22:18:44.114ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40072024-12-18T22:18:44.114ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40082024-12-18T22:18:44.115ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 323.560079ms iteration = 10 status = {}
40092024-12-18T22:18:44.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40102024-12-18T22:18:44.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40112024-12-18T22:18:44.145ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
40122024-12-18T22:18:44.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40132024-12-18T22:18:44.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40142024-12-18T22:18:44.152ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40152024-12-18T22:18:44.153ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1581f7d4-fa1a-47d8-b159-aaa23f053500", "content-length": "134", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40162024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40172024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
40182024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40192024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40202024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40212024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40222024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40232024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40242024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40252024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40262024-12-18T22:18:44.153ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
40272024-12-18T22:18:44.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40282024-12-18T22:18:44.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40292024-12-18T22:18:44.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40302024-12-18T22:18:44.155ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "48e1fcfd-dc57-4b7c-8e3c-a63eb1303374", "content-length": "2", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40312024-12-18T22:18:44.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40322024-12-18T22:18:44.155ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a54a269-1788-4019-9c35-a983e6f6a781", "content-length": "52", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40332024-12-18T22:18:44.155ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
40342024-12-18T22:18:44.155ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40352024-12-18T22:18:44.252ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ef1e7e7c-b0b1-4c9b-804e-e9b0bd97040d", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40362024-12-18T22:18:44.252ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
40372024-12-18T22:18:44.252ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40382024-12-18T22:18:44.252ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "16bffdde-5d7b-453a-8932-7ab648888176", "content-length": "682", "date": "Wed, 18 Dec 2024 22:18:44 GMT"} })
40392024-12-18T22:18:44.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40402024-12-18T22:18:44.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40412024-12-18T22:18:44.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40422024-12-18T22:18:44.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40432024-12-18T22:18:44.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40442024-12-18T22:18:44.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40452024-12-18T22:18:44.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40462024-12-18T22:18:44.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40472024-12-18T22:18:44.268ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.947418ms iteration = 10 status = {}
40482024-12-18T22:18:44.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57f00a11-da8e-490e-9ac5-68f978a234d6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40492024-12-18T22:18:44.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57f00a11-da8e-490e-9ac5-68f978a234d6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40502024-12-18T22:18:44.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57f00a11-da8e-490e-9ac5-68f978a234d6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40512024-12-18T22:18:45.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6ca9eb34-e923-43ce-b66c-61f37f433ce7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40522024-12-18T22:18:45.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6ca9eb34-e923-43ce-b66c-61f37f433ce7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40532024-12-18T22:18:45.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6ca9eb34-e923-43ce-b66c-61f37f433ce7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40542024-12-18T22:18:46.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 740a84bc-a5b6-4162-a661-480770f797ec roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40552024-12-18T22:18:46.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 740a84bc-a5b6-4162-a661-480770f797ec resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40562024-12-18T22:18:46.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 740a84bc-a5b6-4162-a661-480770f797ec response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40572024-12-18T22:18:46.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 812 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 99ea568d-593d-4405-bab0-45b690fa39f4 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
40582024-12-18T22:18:47.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9da3733d-fb3f-4ffb-ac5d-00605af18aa8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40592024-12-18T22:18:47.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9da3733d-fb3f-4ffb-ac5d-00605af18aa8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40602024-12-18T22:18:47.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9da3733d-fb3f-4ffb-ac5d-00605af18aa8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40612024-12-18T22:18:48.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be0530e1-0f6a-417e-adf2-92a6444994fa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40622024-12-18T22:18:48.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be0530e1-0f6a-417e-adf2-92a6444994fa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40632024-12-18T22:18:48.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be0530e1-0f6a-417e-adf2-92a6444994fa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40642024-12-18T22:18:49.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 375b7262-d053-4290-ad8e-076315d26fa6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40652024-12-18T22:18:49.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 375b7262-d053-4290-ad8e-076315d26fa6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40662024-12-18T22:18:49.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 375b7262-d053-4290-ad8e-076315d26fa6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40672024-12-18T22:18:50.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a735d99-f83d-4cf4-a4dd-cd3b44184f1b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40682024-12-18T22:18:50.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a735d99-f83d-4cf4-a4dd-cd3b44184f1b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40692024-12-18T22:18:50.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a735d99-f83d-4cf4-a4dd-cd3b44184f1b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40702024-12-18T22:18:51.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03882272-112d-4d60-bb2b-27b5b62e1aef roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40712024-12-18T22:18:51.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03882272-112d-4d60-bb2b-27b5b62e1aef resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40722024-12-18T22:18:51.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03882272-112d-4d60-bb2b-27b5b62e1aef response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40732024-12-18T22:18:52.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98cb4e8f-e558-4281-b043-ab366e519f2a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40742024-12-18T22:18:52.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98cb4e8f-e558-4281-b043-ab366e519f2a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40752024-12-18T22:18:52.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98cb4e8f-e558-4281-b043-ab366e519f2a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40762024-12-18T22:18:53.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 351df978-cfe0-46b1-b777-ff87ebf77d0c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40772024-12-18T22:18:53.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 351df978-cfe0-46b1-b777-ff87ebf77d0c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40782024-12-18T22:18:53.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 351df978-cfe0-46b1-b777-ff87ebf77d0c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
40792024-12-18T22:18:53.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
40802024-12-18T22:18:53.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
40812024-12-18T22:18:53.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40822024-12-18T22:18:53.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40832024-12-18T22:18:53.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40842024-12-18T22:18:53.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40852024-12-18T22:18:53.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40862024-12-18T22:18:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40872024-12-18T22:18:53.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40882024-12-18T22:18:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40892024-12-18T22:18:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40902024-12-18T22:18:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40912024-12-18T22:18:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40922024-12-18T22:18:53.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40932024-12-18T22:18:53.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40942024-12-18T22:18:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
40952024-12-18T22:18:53.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40962024-12-18T22:18:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40972024-12-18T22:18:53.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
40982024-12-18T22:18:53.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.221937ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
40992024-12-18T22:18:53.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.470235ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41002024-12-18T22:18:54.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f883596-edd6-4be5-a891-9572c571b270 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41012024-12-18T22:18:54.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f883596-edd6-4be5-a891-9572c571b270 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41022024-12-18T22:18:54.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f883596-edd6-4be5-a891-9572c571b270 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41032024-12-18T22:18:55.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3490d0d4-16a8-4ec0-adee-f4408c0c88cf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41042024-12-18T22:18:55.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3490d0d4-16a8-4ec0-adee-f4408c0c88cf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41052024-12-18T22:18:55.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3490d0d4-16a8-4ec0-adee-f4408c0c88cf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41062024-12-18T22:18:56.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cdba7af-4181-4b91-b931-0d6a162a3537 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41072024-12-18T22:18:56.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cdba7af-4181-4b91-b931-0d6a162a3537 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41082024-12-18T22:18:56.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cdba7af-4181-4b91-b931-0d6a162a3537 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41092024-12-18T22:18:56.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 666 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 69f4a314-b166-4513-b734-65695984872f response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
41102024-12-18T22:18:57.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 850c1a14-8d33-4da8-a3cc-9db3df50d838 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41112024-12-18T22:18:57.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 850c1a14-8d33-4da8-a3cc-9db3df50d838 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41122024-12-18T22:18:57.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 850c1a14-8d33-4da8-a3cc-9db3df50d838 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41132024-12-18T22:18:58.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34dec0c0-1600-4ef3-955d-f0fbb84bcbf5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41142024-12-18T22:18:58.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34dec0c0-1600-4ef3-955d-f0fbb84bcbf5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41152024-12-18T22:18:58.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34dec0c0-1600-4ef3-955d-f0fbb84bcbf5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41162024-12-18T22:18:59.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11394ff0-0330-444d-8bba-15b82e773c13 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41172024-12-18T22:18:59.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11394ff0-0330-444d-8bba-15b82e773c13 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41182024-12-18T22:18:59.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11394ff0-0330-444d-8bba-15b82e773c13 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41192024-12-18T22:19:00.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f8d943f1-a718-4ace-bd91-27b825b0c503 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41202024-12-18T22:19:00.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f8d943f1-a718-4ace-bd91-27b825b0c503 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41212024-12-18T22:19:00.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f8d943f1-a718-4ace-bd91-27b825b0c503 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41222024-12-18T22:19:01.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 162be338-695c-41ba-9530-f593554b4cbe roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41232024-12-18T22:19:01.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 162be338-695c-41ba-9530-f593554b4cbe resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41242024-12-18T22:19:01.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 162be338-695c-41ba-9530-f593554b4cbe response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41252024-12-18T22:19:02.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb7c0dd1-e24e-4fcf-a6ba-135a7c0e4d6d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41262024-12-18T22:19:02.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb7c0dd1-e24e-4fcf-a6ba-135a7c0e4d6d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41272024-12-18T22:19:02.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb7c0dd1-e24e-4fcf-a6ba-135a7c0e4d6d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41282024-12-18T22:19:03.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e71c93-e121-46ba-8fdb-bf9aae48fe21 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41292024-12-18T22:19:03.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e71c93-e121-46ba-8fdb-bf9aae48fe21 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41302024-12-18T22:19:03.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e71c93-e121-46ba-8fdb-bf9aae48fe21 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41312024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
41322024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
41332024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41342024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41352024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41362024-12-18T22:19:03.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41372024-12-18T22:19:03.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41382024-12-18T22:19:03.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41392024-12-18T22:19:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41402024-12-18T22:19:03.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.770224ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41412024-12-18T22:19:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41422024-12-18T22:19:03.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41432024-12-18T22:19:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41442024-12-18T22:19:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41452024-12-18T22:19:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41462024-12-18T22:19:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41472024-12-18T22:19:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
41482024-12-18T22:19:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41492024-12-18T22:19:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41502024-12-18T22:19:03.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
41512024-12-18T22:19:03.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.143833ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
41522024-12-18T22:19:04.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db84d162-bd97-4b15-b73a-fdffabc6bb2a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41532024-12-18T22:19:04.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db84d162-bd97-4b15-b73a-fdffabc6bb2a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41542024-12-18T22:19:04.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db84d162-bd97-4b15-b73a-fdffabc6bb2a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41552024-12-18T22:19:05.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0c19ffcd-a1f1-4811-b9aa-68115a0cf4b3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41562024-12-18T22:19:05.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0c19ffcd-a1f1-4811-b9aa-68115a0cf4b3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41572024-12-18T22:19:05.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0c19ffcd-a1f1-4811-b9aa-68115a0cf4b3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41582024-12-18T22:19:06.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 681 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 1d3162c3-2f05-411c-852d-59322cdf304c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
41592024-12-18T22:19:06.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7eb44927-f370-4deb-b8a7-f22ad2df6605 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41602024-12-18T22:19:06.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7eb44927-f370-4deb-b8a7-f22ad2df6605 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41612024-12-18T22:19:06.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7eb44927-f370-4deb-b8a7-f22ad2df6605 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41622024-12-18T22:19:07.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9980ed4-d1c3-4de6-bec9-3f82da3fa602 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41632024-12-18T22:19:07.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9980ed4-d1c3-4de6-bec9-3f82da3fa602 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41642024-12-18T22:19:07.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9980ed4-d1c3-4de6-bec9-3f82da3fa602 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41652024-12-18T22:19:08.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7d23c43-966d-4167-903c-50c51eb89c9e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41662024-12-18T22:19:08.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7d23c43-966d-4167-903c-50c51eb89c9e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41672024-12-18T22:19:08.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7d23c43-966d-4167-903c-50c51eb89c9e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41682024-12-18T22:19:09.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = de15f28d-9e1d-4141-b5a7-4cad46dce959 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41692024-12-18T22:19:09.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = de15f28d-9e1d-4141-b5a7-4cad46dce959 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41702024-12-18T22:19:09.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = de15f28d-9e1d-4141-b5a7-4cad46dce959 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41712024-12-18T22:19:10.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b7ff1bfd-5213-4ee2-9a68-d1361e4dd488 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41722024-12-18T22:19:10.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b7ff1bfd-5213-4ee2-9a68-d1361e4dd488 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41732024-12-18T22:19:10.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b7ff1bfd-5213-4ee2-9a68-d1361e4dd488 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41742024-12-18T22:19:11.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e9b0eb79-c7ad-4abc-9ada-26892b2023c8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41752024-12-18T22:19:11.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e9b0eb79-c7ad-4abc-9ada-26892b2023c8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41762024-12-18T22:19:11.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e9b0eb79-c7ad-4abc-9ada-26892b2023c8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41772024-12-18T22:19:12.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf6fe0b1-b680-4536-9862-d5023c6a4e04 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41782024-12-18T22:19:12.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf6fe0b1-b680-4536-9862-d5023c6a4e04 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41792024-12-18T22:19:12.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf6fe0b1-b680-4536-9862-d5023c6a4e04 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
41802024-12-18T22:19:13.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1b1a70e4-6b9f-4129-957a-7e1fdc8474c6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41812024-12-18T22:19:13.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1b1a70e4-6b9f-4129-957a-7e1fdc8474c6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41822024-12-18T22:19:13.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1b1a70e4-6b9f-4129-957a-7e1fdc8474c6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41832024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
41842024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
41852024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
41862024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41872024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41882024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
41892024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41902024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
41912024-12-18T22:19:13.792ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
41922024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
41932024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.01\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
41942024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41952024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
41962024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
41972024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41982024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
41992024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
42002024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42012024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
42022024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
42032024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42042024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
42052024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42062024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
42072024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42082024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
42092024-12-18T22:19:13.792ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:09:13.792882995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42102024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42112024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
42122024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
42132024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42142024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
42152024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42162024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42172024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
42182024-12-18T22:19:13.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
42192024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42202024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42212024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
42222024-12-18T22:19:13.793ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42232024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
42242024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42252024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42262024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
42272024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42282024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
42292024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42302024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42312024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
42322024-12-18T22:19:13.793ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
42332024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42342024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
42352024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
42362024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42372024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42382024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
42392024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42402024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42412024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42422024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
42432024-12-18T22:19:13.793ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42442024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42452024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
42462024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42472024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
42482024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42492024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42502024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42512024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42522024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42532024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42542024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42552024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42562024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42572024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42582024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42592024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42602024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42612024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42622024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42632024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42642024-12-18T22:19:13.793ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 416478741 } })
42652024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42662024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42672024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42682024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42692024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42702024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42712024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42722024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42732024-12-18T22:19:13.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42742024-12-18T22:19:13.793ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 416552662 } })
42752024-12-18T22:19:13.794ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
42762024-12-18T22:19:13.794ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.263395ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
42772024-12-18T22:19:13.794ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
42782024-12-18T22:19:13.794ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.238474ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
42792024-12-18T22:19:13.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42802024-12-18T22:19:13.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812024-12-18T22:19:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.330106ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42822024-12-18T22:19:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.936937ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
42832024-12-18T22:19:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42842024-12-18T22:19:13.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42852024-12-18T22:19:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42862024-12-18T22:19:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42872024-12-18T22:19:13.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42882024-12-18T22:19:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42892024-12-18T22:19:13.801ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:09:13.792882995 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42902024-12-18T22:19:13.801ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.242742ms iteration = 6 status = {"expiration":"2024-12-18T22:09:13.792882995Z","pruned":[]}
42912024-12-18T22:19:13.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-12-18T22:19:13.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42932024-12-18T22:19:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42942024-12-18T22:19:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42952024-12-18T22:19:13.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42962024-12-18T22:19:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42972024-12-18T22:19:13.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42982024-12-18T22:19:13.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42992024-12-18T22:19:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43002024-12-18T22:19:13.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43012024-12-18T22:19:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43022024-12-18T22:19:13.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43032024-12-18T22:19:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43042024-12-18T22:19:13.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43052024-12-18T22:19:13.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43062024-12-18T22:19:13.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072024-12-18T22:19:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43082024-12-18T22:19:13.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 431993945 } })
43092024-12-18T22:19:13.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43102024-12-18T22:19:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43112024-12-18T22:19:13.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43122024-12-18T22:19:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43132024-12-18T22:19:13.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43142024-12-18T22:19:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43152024-12-18T22:19:13.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43162024-12-18T22:19:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43172024-12-18T22:19:13.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 436300840 } })
43182024-12-18T22:19:13.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43192024-12-18T22:19:13.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 437362721 } })
43202024-12-18T22:19:13.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
43212024-12-18T22:19:13.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43222024-12-18T22:19:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43232024-12-18T22:19:13.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43242024-12-18T22:19:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43252024-12-18T22:19:13.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43262024-12-18T22:19:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43272024-12-18T22:19:13.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43282024-12-18T22:19:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43292024-12-18T22:19:13.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43302024-12-18T22:19:13.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
43312024-12-18T22:19:13.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322024-12-18T22:19:13.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43332024-12-18T22:19:13.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43342024-12-18T22:19:13.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43352024-12-18T22:19:13.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43362024-12-18T22:19:13.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43372024-12-18T22:19:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43382024-12-18T22:19:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43392024-12-18T22:19:13.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43402024-12-18T22:19:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43412024-12-18T22:19:13.835ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43422024-12-18T22:19:13.835ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43432024-12-18T22:19:13.835ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 42.620066ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43442024-12-18T22:19:13.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43452024-12-18T22:19:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43462024-12-18T22:19:13.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43472024-12-18T22:19:13.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43482024-12-18T22:19:13.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43492024-12-18T22:19:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43502024-12-18T22:19:13.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43512024-12-18T22:19:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43522024-12-18T22:19:13.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-12-18T22:19:13.849ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43542024-12-18T22:19:13.849ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43552024-12-18T22:19:13.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43562024-12-18T22:19:13.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43572024-12-18T22:19:13.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43582024-12-18T22:19:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43592024-12-18T22:19:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43602024-12-18T22:19:13.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43612024-12-18T22:19:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43622024-12-18T22:19:13.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43632024-12-18T22:19:13.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43642024-12-18T22:19:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43652024-12-18T22:19:13.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43662024-12-18T22:19:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43672024-12-18T22:19:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43682024-12-18T22:19:13.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43692024-12-18T22:19:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-12-18T22:19:13.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
43712024-12-18T22:19:13.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.094546ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
43722024-12-18T22:19:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.356849ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43732024-12-18T22:19:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.473362ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
43742024-12-18T22:19:13.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43752024-12-18T22:19:13.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.998332ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
43762024-12-18T22:19:13.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-12-18T22:19:13.868ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43782024-12-18T22:19:13.868ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43792024-12-18T22:19:13.868ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43802024-12-18T22:19:13.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43812024-12-18T22:19:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43822024-12-18T22:19:13.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832024-12-18T22:19:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
43842024-12-18T22:19:13.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43852024-12-18T22:19:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43862024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43872024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43882024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43892024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43902024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43912024-12-18T22:19:13.871ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43922024-12-18T22:19:13.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.959959ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43932024-12-18T22:19:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43942024-12-18T22:19:13.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-12-18T22:19:13.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43962024-12-18T22:19:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43972024-12-18T22:19:13.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43982024-12-18T22:19:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43992024-12-18T22:19:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44002024-12-18T22:19:13.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44012024-12-18T22:19:13.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022024-12-18T22:19:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44032024-12-18T22:19:13.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44042024-12-18T22:19:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44052024-12-18T22:19:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44062024-12-18T22:19:13.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44072024-12-18T22:19:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44082024-12-18T22:19:13.880ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44092024-12-18T22:19:13.880ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44102024-12-18T22:19:13.880ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.592828ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44112024-12-18T22:19:13.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44122024-12-18T22:19:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44132024-12-18T22:19:13.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44142024-12-18T22:19:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44152024-12-18T22:19:13.887ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44162024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44172024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44182024-12-18T22:19:13.888ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44192024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44202024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44212024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44222024-12-18T22:19:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44232024-12-18T22:19:13.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44242024-12-18T22:19:13.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44252024-12-18T22:19:13.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44262024-12-18T22:19:13.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44272024-12-18T22:19:13.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44282024-12-18T22:19:13.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44292024-12-18T22:19:13.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44302024-12-18T22:19:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44312024-12-18T22:19:13.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.116534ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44322024-12-18T22:19:13.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44332024-12-18T22:19:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44342024-12-18T22:19:13.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.819538ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44352024-12-18T22:19:13.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-12-18T22:19:13.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44372024-12-18T22:19:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44382024-12-18T22:19:13.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44392024-12-18T22:19:13.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44402024-12-18T22:19:13.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44412024-12-18T22:19:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44422024-12-18T22:19:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44432024-12-18T22:19:13.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44442024-12-18T22:19:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
44452024-12-18T22:19:13.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44462024-12-18T22:19:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44472024-12-18T22:19:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.110439ms iteration = 11 status = 0
44482024-12-18T22:19:13.910ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44492024-12-18T22:19:13.910ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44502024-12-18T22:19:13.910ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44512024-12-18T22:19:13.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44522024-12-18T22:19:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44532024-12-18T22:19:13.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44542024-12-18T22:19:13.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44552024-12-18T22:19:13.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44562024-12-18T22:19:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44572024-12-18T22:19:13.918ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44582024-12-18T22:19:13.918ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44592024-12-18T22:19:13.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.194476ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44602024-12-18T22:19:13.923ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44612024-12-18T22:19:13.923ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
44622024-12-18T22:19:13.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44632024-12-18T22:19:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44642024-12-18T22:19:13.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44652024-12-18T22:19:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44662024-12-18T22:19:13.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44672024-12-18T22:19:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44682024-12-18T22:19:13.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.270503ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44692024-12-18T22:19:13.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
44702024-12-18T22:19:13.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44712024-12-18T22:19:13.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
44722024-12-18T22:19:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.768822ms iteration = 6 status = {"generation":2}
44732024-12-18T22:19:13.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44742024-12-18T22:19:13.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752024-12-18T22:19:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44762024-12-18T22:19:13.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44772024-12-18T22:19:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44782024-12-18T22:19:13.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44792024-12-18T22:19:13.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44802024-12-18T22:19:13.951ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
44812024-12-18T22:19:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 159.168843ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44822024-12-18T22:19:13.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44832024-12-18T22:19:13.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44842024-12-18T22:19:13.955ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44852024-12-18T22:19:13.955ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44862024-12-18T22:19:13.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44872024-12-18T22:19:13.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44882024-12-18T22:19:13.956ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44892024-12-18T22:19:13.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44902024-12-18T22:19:13.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44912024-12-18T22:19:13.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44922024-12-18T22:19:13.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44932024-12-18T22:19:13.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44942024-12-18T22:19:13.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44952024-12-18T22:19:13.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44962024-12-18T22:19:13.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44972024-12-18T22:19:13.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44982024-12-18T22:19:13.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44992024-12-18T22:19:13.963ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45002024-12-18T22:19:13.963ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45012024-12-18T22:19:13.963ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
45022024-12-18T22:19:13.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 170.24419ms iteration = 6 status = {"generation":1}
45032024-12-18T22:19:13.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45042024-12-18T22:19:13.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45052024-12-18T22:19:13.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-12-18T22:19:13.967ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45072024-12-18T22:19:13.967ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 174.344801ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45082024-12-18T22:19:13.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
45092024-12-18T22:19:13.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45102024-12-18T22:19:13.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45112024-12-18T22:19:13.975ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.201445ms iteration = 13 status = {"physical_disks_added":0}
45122024-12-18T22:19:13.989ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
45132024-12-18T22:19:13.989ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45142024-12-18T22:19:13.989ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc0a210-c182-4c63-a6b6-d1242aeae6ce", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:13 GMT"} })
45152024-12-18T22:19:13.990ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45162024-12-18T22:19:13.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
45172024-12-18T22:19:13.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14b249a1-5373-4547-8db4-44c89ce0e6a4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
45182024-12-18T22:19:13.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14b249a1-5373-4547-8db4-44c89ce0e6a4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
45192024-12-18T22:19:13.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45202024-12-18T22:19:13.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45212024-12-18T22:19:14.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45222024-12-18T22:19:14.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45232024-12-18T22:19:14.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd90599-5a66-458e-846b-5d17beed09e9", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:13 GMT"} })
45242024-12-18T22:19:14.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45252024-12-18T22:19:14.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45262024-12-18T22:19:14.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45272024-12-18T22:19:14.117ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45282024-12-18T22:19:14.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45292024-12-18T22:19:14.117ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c141626f-8a41-4249-a62f-f292de39ca03", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:13 GMT"} })
45302024-12-18T22:19:14.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45312024-12-18T22:19:14.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d621b249-7fa3-408a-b6ac-6769297c4026", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45322024-12-18T22:19:14.118ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45332024-12-18T22:19:14.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45342024-12-18T22:19:14.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d525ad61-8f95-467c-a06c-c33f89d00d84", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45352024-12-18T22:19:14.120ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45362024-12-18T22:19:14.122ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45372024-12-18T22:19:14.122ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 330.172768ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45382024-12-18T22:19:14.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45392024-12-18T22:19:14.129ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45402024-12-18T22:19:14.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45412024-12-18T22:19:14.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "87341b54-8827-46d0-985a-5a22c3b8d482", "content-length": "372", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
45422024-12-18T22:19:14.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45432024-12-18T22:19:14.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45442024-12-18T22:19:14.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45452024-12-18T22:19:14.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45462024-12-18T22:19:14.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45472024-12-18T22:19:14.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14b249a1-5373-4547-8db4-44c89ce0e6a4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
45482024-12-18T22:19:14.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45492024-12-18T22:19:14.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45502024-12-18T22:19:14.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45512024-12-18T22:19:14.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45522024-12-18T22:19:14.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45532024-12-18T22:19:14.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45542024-12-18T22:19:14.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
45552024-12-18T22:19:14.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45562024-12-18T22:19:14.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45572024-12-18T22:19:14.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45582024-12-18T22:19:14.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45592024-12-18T22:19:14.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45602024-12-18T22:19:14.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45612024-12-18T22:19:14.144ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45622024-12-18T22:19:14.145ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45632024-12-18T22:19:14.145ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c7f9da1e-3161-42ad-8d17-0e71cd89c64c", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
45642024-12-18T22:19:14.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45652024-12-18T22:19:14.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45662024-12-18T22:19:14.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45672024-12-18T22:19:14.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45682024-12-18T22:19:14.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45692024-12-18T22:19:14.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45702024-12-18T22:19:14.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45712024-12-18T22:19:14.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45722024-12-18T22:19:14.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45732024-12-18T22:19:14.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45742024-12-18T22:19:14.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45752024-12-18T22:19:14.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45762024-12-18T22:19:14.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45772024-12-18T22:19:14.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45782024-12-18T22:19:14.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45792024-12-18T22:19:14.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45802024-12-18T22:19:14.154ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45812024-12-18T22:19:14.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45822024-12-18T22:19:14.154ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e8f8adbd-a7a4-4ad6-9e7f-f9d18cc6f554", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
45832024-12-18T22:19:14.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45842024-12-18T22:19:14.156ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 363.488162ms iteration = 11 status = {}
45852024-12-18T22:19:14.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
45862024-12-18T22:19:14.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45872024-12-18T22:19:14.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45882024-12-18T22:19:14.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45892024-12-18T22:19:14.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45902024-12-18T22:19:14.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45912024-12-18T22:19:14.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-12-18T22:19:14.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45932024-12-18T22:19:14.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45942024-12-18T22:19:14.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45952024-12-18T22:19:14.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45962024-12-18T22:19:14.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45972024-12-18T22:19:14.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
45982024-12-18T22:19:14.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45992024-12-18T22:19:14.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46002024-12-18T22:19:14.172ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
46012024-12-18T22:19:14.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46022024-12-18T22:19:14.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46032024-12-18T22:19:14.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46042024-12-18T22:19:14.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
46052024-12-18T22:19:14.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46062024-12-18T22:19:14.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46072024-12-18T22:19:14.189ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
46082024-12-18T22:19:14.189ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
46092024-12-18T22:19:14.189ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
46102024-12-18T22:19:14.262ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46112024-12-18T22:19:14.262ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0e57e0-e417-4042-abd3-6f5a42200339", "content-length": "1", "date": "Wed, 18 Dec 2024 22:19:13 GMT"} })
46122024-12-18T22:19:14.263ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46132024-12-18T22:19:14.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46142024-12-18T22:19:14.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46152024-12-18T22:19:14.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a9d7a97c-fe53-49f3-bb3c-dfc6e05b97d2", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46162024-12-18T22:19:14.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46172024-12-18T22:19:14.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ecda02db-e23e-4f54-8ccf-ca52cf75cd26", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46182024-12-18T22:19:14.287ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46192024-12-18T22:19:14.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "22d259ca-eec2-4083-af1c-1544b0fbab50", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46202024-12-18T22:19:14.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46212024-12-18T22:19:14.290ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
46222024-12-18T22:19:14.290ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 498.234905ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46232024-12-18T22:19:14.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46242024-12-18T22:19:14.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10d2b122-d3cd-4485-9b27-b4bb5aa6eb82", "content-length": "691", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46252024-12-18T22:19:14.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46262024-12-18T22:19:14.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46272024-12-18T22:19:14.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46282024-12-18T22:19:14.306ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 513.75676ms iteration = 11 status = null
46292024-12-18T22:19:14.307ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.985424ms iteration = 11 status = {}
46302024-12-18T22:19:14.340ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 547.874239ms iteration = 11 status = {}
46312024-12-18T22:19:14.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46322024-12-18T22:19:14.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46332024-12-18T22:19:14.387ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
46342024-12-18T22:19:14.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46352024-12-18T22:19:14.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46362024-12-18T22:19:14.439ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, time_created: 2024-12-18T22:14:41.637384Z, time_modified: 2024-12-18T22:14:41.637384Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
46372024-12-18T22:19:14.439ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
46382024-12-18T22:19:14.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46392024-12-18T22:19:14.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46402024-12-18T22:19:14.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46412024-12-18T22:19:14.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46422024-12-18T22:19:14.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46432024-12-18T22:19:14.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
46442024-12-18T22:19:14.476ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
46452024-12-18T22:19:14.476ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "65b3e888-bd10-48cd-baa6-939ee76881fd", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46462024-12-18T22:19:14.478ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
46472024-12-18T22:19:14.478ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 685.687953ms
46482024-12-18T22:19:14.478ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 685.698813ms iteration = 2 status = {}
46492024-12-18T22:19:14.503ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46502024-12-18T22:19:14.504ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0ad6b8-f75f-4e49-bbff-ff9a41260089", "content-length": "134", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46512024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46522024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
46532024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46542024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46552024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46562024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46572024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46582024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46592024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46602024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46612024-12-18T22:19:14.504ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
46622024-12-18T22:19:14.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46632024-12-18T22:19:14.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46642024-12-18T22:19:14.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46652024-12-18T22:19:14.507ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7ae308d-e7fd-4694-8672-5c686fb93459", "content-length": "2", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46662024-12-18T22:19:14.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46672024-12-18T22:19:14.507ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "247a36d4-86e3-4162-a46e-54e47b080bf0", "content-length": "52", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46682024-12-18T22:19:14.507ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
46692024-12-18T22:19:14.507ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46702024-12-18T22:19:14.589ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "47e41153-41c2-4cc6-9f64-225862800fce", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46712024-12-18T22:19:14.589ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
46722024-12-18T22:19:14.589ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46732024-12-18T22:19:14.589ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7db30aa4-1e0f-47e0-8b69-da8cd37d2636", "content-length": "682", "date": "Wed, 18 Dec 2024 22:19:14 GMT"} })
46742024-12-18T22:19:14.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46752024-12-18T22:19:14.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46762024-12-18T22:19:14.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46772024-12-18T22:19:14.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46782024-12-18T22:19:14.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46792024-12-18T22:19:14.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46802024-12-18T22:19:14.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46812024-12-18T22:19:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46822024-12-18T22:19:14.606ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 813.754776ms iteration = 11 status = {}
46832024-12-18T22:19:15.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d26f359a-ccbf-434c-8eef-2a5a36a3ea03 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46842024-12-18T22:19:15.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d26f359a-ccbf-434c-8eef-2a5a36a3ea03 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46852024-12-18T22:19:15.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d26f359a-ccbf-434c-8eef-2a5a36a3ea03 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46862024-12-18T22:19:16.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9c28b086-8d06-4aca-b6ba-5cefbc406872 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46872024-12-18T22:19:16.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9c28b086-8d06-4aca-b6ba-5cefbc406872 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46882024-12-18T22:19:16.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9c28b086-8d06-4aca-b6ba-5cefbc406872 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46892024-12-18T22:19:16.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 537 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 3d40e510-2490-4a5f-801d-9b619bfd1cac response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
46902024-12-18T22:19:17.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 47b02538-a091-4f19-8adf-3f38ecbafffd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46912024-12-18T22:19:17.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 47b02538-a091-4f19-8adf-3f38ecbafffd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46922024-12-18T22:19:17.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 47b02538-a091-4f19-8adf-3f38ecbafffd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46932024-12-18T22:19:18.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 63118d9e-416c-41ce-a4fa-6b974de03a5c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46942024-12-18T22:19:18.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 63118d9e-416c-41ce-a4fa-6b974de03a5c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46952024-12-18T22:19:18.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 63118d9e-416c-41ce-a4fa-6b974de03a5c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46962024-12-18T22:19:19.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9685442f-0f64-4479-8bb4-467940871ce9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46972024-12-18T22:19:19.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9685442f-0f64-4479-8bb4-467940871ce9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46982024-12-18T22:19:19.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9685442f-0f64-4479-8bb4-467940871ce9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
46992024-12-18T22:19:20.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3899ce39-6c37-46a2-84a0-6a37800a9005 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47002024-12-18T22:19:20.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3899ce39-6c37-46a2-84a0-6a37800a9005 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47012024-12-18T22:19:20.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3899ce39-6c37-46a2-84a0-6a37800a9005 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47022024-12-18T22:19:21.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7833cec9-dc21-486a-8bfb-826f7cc07a03 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47032024-12-18T22:19:21.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7833cec9-dc21-486a-8bfb-826f7cc07a03 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47042024-12-18T22:19:21.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7833cec9-dc21-486a-8bfb-826f7cc07a03 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47052024-12-18T22:19:22.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9780e361-e8c5-4c33-a5d2-d7a866421117 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47062024-12-18T22:19:22.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9780e361-e8c5-4c33-a5d2-d7a866421117 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47072024-12-18T22:19:22.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9780e361-e8c5-4c33-a5d2-d7a866421117 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47082024-12-18T22:19:23.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b3f8df51-eacc-43fb-9671-7e5d97364459 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47092024-12-18T22:19:23.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b3f8df51-eacc-43fb-9671-7e5d97364459 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47102024-12-18T22:19:23.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b3f8df51-eacc-43fb-9671-7e5d97364459 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47112024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
47122024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
47132024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47142024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47152024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47162024-12-18T22:19:23.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47172024-12-18T22:19:23.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182024-12-18T22:19:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47192024-12-18T22:19:23.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47202024-12-18T22:19:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47212024-12-18T22:19:23.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47222024-12-18T22:19:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47232024-12-18T22:19:23.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47242024-12-18T22:19:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
47252024-12-18T22:19:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262024-12-18T22:19:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272024-12-18T22:19:23.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
47282024-12-18T22:19:23.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.070163ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
47292024-12-18T22:19:23.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47302024-12-18T22:19:23.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47312024-12-18T22:19:23.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.938693ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47322024-12-18T22:19:24.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 714e4ada-d738-47ca-885e-7966a67f9a38 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47332024-12-18T22:19:24.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 714e4ada-d738-47ca-885e-7966a67f9a38 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47342024-12-18T22:19:24.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 714e4ada-d738-47ca-885e-7966a67f9a38 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47352024-12-18T22:19:25.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5bce3fa7-d836-4c5d-83dd-50cc0b8e9876 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47362024-12-18T22:19:25.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5bce3fa7-d836-4c5d-83dd-50cc0b8e9876 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47372024-12-18T22:19:25.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5bce3fa7-d836-4c5d-83dd-50cc0b8e9876 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47382024-12-18T22:19:26.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a87a62d-e124-4ca0-9954-22a59b7df399 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47392024-12-18T22:19:26.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a87a62d-e124-4ca0-9954-22a59b7df399 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47402024-12-18T22:19:26.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a87a62d-e124-4ca0-9954-22a59b7df399 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47412024-12-18T22:19:26.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 25d01b1d-81ef-4ab5-8ec2-a8c08757609f roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
47422024-12-18T22:19:26.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 25d01b1d-81ef-4ab5-8ec2-a8c08757609f resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
47432024-12-18T22:19:26.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 25d01b1d-81ef-4ab5-8ec2-a8c08757609f response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
47442024-12-18T22:19:26.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = d06481f2-e348-451d-b4a0-60303d696092 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
47452024-12-18T22:19:26.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = d06481f2-e348-451d-b4a0-60303d696092 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
47462024-12-18T22:19:26.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = d06481f2-e348-451d-b4a0-60303d696092 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
47472024-12-18T22:19:26.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 14cec957-fffb-445a-bb1b-90fb40242e3c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
47482024-12-18T22:19:27.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 049e5620-654c-487b-a2c3-c0fc9b1bf7bd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47492024-12-18T22:19:27.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 049e5620-654c-487b-a2c3-c0fc9b1bf7bd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47502024-12-18T22:19:27.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 049e5620-654c-487b-a2c3-c0fc9b1bf7bd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47512024-12-18T22:19:28.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 424a3f4c-7f38-4733-a938-f6cb686229db roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47522024-12-18T22:19:28.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 424a3f4c-7f38-4733-a938-f6cb686229db resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47532024-12-18T22:19:28.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 424a3f4c-7f38-4733-a938-f6cb686229db response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47542024-12-18T22:19:29.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d8bc82bd-e1a7-4632-a71f-974d40f19df2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47552024-12-18T22:19:29.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d8bc82bd-e1a7-4632-a71f-974d40f19df2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47562024-12-18T22:19:29.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d8bc82bd-e1a7-4632-a71f-974d40f19df2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47572024-12-18T22:19:30.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c6d3ff42-43c4-4d7f-b66a-50c68d51d1b4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47582024-12-18T22:19:30.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c6d3ff42-43c4-4d7f-b66a-50c68d51d1b4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47592024-12-18T22:19:30.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c6d3ff42-43c4-4d7f-b66a-50c68d51d1b4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47602024-12-18T22:19:31.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3016c4a-676a-4cc9-bae2-afd13821aca3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47612024-12-18T22:19:31.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3016c4a-676a-4cc9-bae2-afd13821aca3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47622024-12-18T22:19:31.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3016c4a-676a-4cc9-bae2-afd13821aca3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47632024-12-18T22:19:32.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8dac18f-7dc1-4a43-a845-b0611a459935 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47642024-12-18T22:19:32.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8dac18f-7dc1-4a43-a845-b0611a459935 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47652024-12-18T22:19:32.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8dac18f-7dc1-4a43-a845-b0611a459935 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47662024-12-18T22:19:33.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d7fda09-9f42-43b1-b758-613cb0414dec roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47672024-12-18T22:19:33.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d7fda09-9f42-43b1-b758-613cb0414dec resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47682024-12-18T22:19:33.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d7fda09-9f42-43b1-b758-613cb0414dec response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47692024-12-18T22:19:33.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
47702024-12-18T22:19:33.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
47712024-12-18T22:19:33.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47722024-12-18T22:19:33.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47732024-12-18T22:19:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47742024-12-18T22:19:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47752024-12-18T22:19:33.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47762024-12-18T22:19:33.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47772024-12-18T22:19:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47782024-12-18T22:19:33.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.216752ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47792024-12-18T22:19:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47802024-12-18T22:19:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812024-12-18T22:19:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47822024-12-18T22:19:33.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47832024-12-18T22:19:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47842024-12-18T22:19:33.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47852024-12-18T22:19:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
47862024-12-18T22:19:33.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872024-12-18T22:19:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882024-12-18T22:19:33.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
47892024-12-18T22:19:33.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.111053ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
47902024-12-18T22:19:34.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4354debd-7144-43be-b4da-f56e2fc6386d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47912024-12-18T22:19:34.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4354debd-7144-43be-b4da-f56e2fc6386d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47922024-12-18T22:19:34.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4354debd-7144-43be-b4da-f56e2fc6386d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47932024-12-18T22:19:35.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4dbbf806-eaaa-4016-bb36-f684c5c9fdc7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47942024-12-18T22:19:35.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4dbbf806-eaaa-4016-bb36-f684c5c9fdc7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47952024-12-18T22:19:35.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4dbbf806-eaaa-4016-bb36-f684c5c9fdc7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47962024-12-18T22:19:36.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f0a797-fa68-4ff6-aca3-d107dba9c4ef roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47972024-12-18T22:19:36.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f0a797-fa68-4ff6-aca3-d107dba9c4ef resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47982024-12-18T22:19:36.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f0a797-fa68-4ff6-aca3-d107dba9c4ef response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
47992024-12-18T22:19:36.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 50f23042-9b1e-4e31-9750-74e83c14dc07 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
48002024-12-18T22:19:37.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 00f6824d-4d2e-4c1e-bf47-18653db45628 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48012024-12-18T22:19:37.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 00f6824d-4d2e-4c1e-bf47-18653db45628 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48022024-12-18T22:19:37.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 00f6824d-4d2e-4c1e-bf47-18653db45628 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48032024-12-18T22:19:38.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a84580f2-133a-4033-8eba-0bed4c5ffa24 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48042024-12-18T22:19:38.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a84580f2-133a-4033-8eba-0bed4c5ffa24 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48052024-12-18T22:19:38.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a84580f2-133a-4033-8eba-0bed4c5ffa24 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48062024-12-18T22:19:39.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f56da402-c90b-4f4d-ac86-8ef713f29356 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48072024-12-18T22:19:39.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f56da402-c90b-4f4d-ac86-8ef713f29356 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48082024-12-18T22:19:39.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f56da402-c90b-4f4d-ac86-8ef713f29356 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48092024-12-18T22:19:40.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7189c44-e4d6-4b7a-8a12-e186196d4dc2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48102024-12-18T22:19:40.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7189c44-e4d6-4b7a-8a12-e186196d4dc2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48112024-12-18T22:19:40.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c7189c44-e4d6-4b7a-8a12-e186196d4dc2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48122024-12-18T22:19:41.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 715f8ca0-505f-42bb-a4a9-74bf7689757a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48132024-12-18T22:19:41.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 715f8ca0-505f-42bb-a4a9-74bf7689757a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48142024-12-18T22:19:41.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 715f8ca0-505f-42bb-a4a9-74bf7689757a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48152024-12-18T22:19:42.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eeda6b05-e498-49b9-9dee-e193f9736a0f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48162024-12-18T22:19:42.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eeda6b05-e498-49b9-9dee-e193f9736a0f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48172024-12-18T22:19:42.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eeda6b05-e498-49b9-9dee-e193f9736a0f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48182024-12-18T22:19:43.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 45f4bfd9-c0de-46c8-81ac-3f5a1eac1dfa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48192024-12-18T22:19:43.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 45f4bfd9-c0de-46c8-81ac-3f5a1eac1dfa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48202024-12-18T22:19:43.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 45f4bfd9-c0de-46c8-81ac-3f5a1eac1dfa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48212024-12-18T22:19:43.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03fcc081-33fe-4155-9524-3f2622e0bfab roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48222024-12-18T22:19:43.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03fcc081-33fe-4155-9524-3f2622e0bfab resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48232024-12-18T22:19:43.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 03fcc081-33fe-4155-9524-3f2622e0bfab response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
48242024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
48252024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
48262024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
48272024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48282024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48292024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48302024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
48312024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
48322024-12-18T22:19:43.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48332024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48342024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
48352024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
48362024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48372024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48382024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
48392024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
48402024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48412024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48422024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
48432024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48442024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
48452024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
48462024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48472024-12-18T22:19:43.793ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48482024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
48492024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48502024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48512024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
48522024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48532024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
48542024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48552024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
48562024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48572024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
48582024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48592024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48602024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48612024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48622024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48632024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48642024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48652024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48662024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48672024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48682024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48692024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48702024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48712024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48722024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48732024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48742024-12-18T22:19:43.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48752024-12-18T22:19:43.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48762024-12-18T22:19:43.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48772024-12-18T22:19:43.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48782024-12-18T22:19:43.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.915047ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48792024-12-18T22:19:43.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48802024-12-18T22:19:43.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48812024-12-18T22:19:43.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48822024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48832024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48842024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48852024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48862024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48872024-12-18T22:19:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48882024-12-18T22:19:43.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 427697931 } })
48892024-12-18T22:19:43.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
48902024-12-18T22:19:43.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 428436605 } })
48912024-12-18T22:19:43.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
48922024-12-18T22:19:43.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48932024-12-18T22:19:43.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48942024-12-18T22:19:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48952024-12-18T22:19:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48962024-12-18T22:19:43.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 431067757 } })
48972024-12-18T22:19:43.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
48982024-12-18T22:19:43.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48992024-12-18T22:19:43.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49002024-12-18T22:19:43.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49012024-12-18T22:19:43.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49022024-12-18T22:19:43.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49032024-12-18T22:19:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49042024-12-18T22:19:43.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49052024-12-18T22:19:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49062024-12-18T22:19:43.839ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49072024-12-18T22:19:43.839ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49082024-12-18T22:19:43.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49092024-12-18T22:19:43.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49102024-12-18T22:19:43.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.760967ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
49112024-12-18T22:19:43.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122024-12-18T22:19:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.172223ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
49132024-12-18T22:19:43.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49142024-12-18T22:19:43.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49152024-12-18T22:19:43.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49162024-12-18T22:19:43.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49172024-12-18T22:19:43.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49182024-12-18T22:19:43.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49192024-12-18T22:19:43.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49202024-12-18T22:19:43.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49222024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49232024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49242024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49252024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49262024-12-18T22:19:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49272024-12-18T22:19:43.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49282024-12-18T22:19:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
49292024-12-18T22:19:43.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49302024-12-18T22:19:43.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49312024-12-18T22:19:43.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49322024-12-18T22:19:43.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49332024-12-18T22:19:43.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49342024-12-18T22:19:43.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49352024-12-18T22:19:43.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49362024-12-18T22:19:43.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49372024-12-18T22:19:43.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49382024-12-18T22:19:43.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
49392024-12-18T22:19:43.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.098763ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
49402024-12-18T22:19:43.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.458099ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49412024-12-18T22:19:43.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-12-18T22:19:43.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49432024-12-18T22:19:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49442024-12-18T22:19:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
49452024-12-18T22:19:43.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49462024-12-18T22:19:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49472024-12-18T22:19:43.880ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.475426ms iteration = 12 status = 0
49482024-12-18T22:19:43.880ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49492024-12-18T22:19:43.880ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49502024-12-18T22:19:43.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49512024-12-18T22:19:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49522024-12-18T22:19:43.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.659898ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49532024-12-18T22:19:43.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49542024-12-18T22:19:43.887ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49552024-12-18T22:19:43.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.465903ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49562024-12-18T22:19:43.887ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "844546a3-c3cb-4fab-809a-6e7f46802461", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
49572024-12-18T22:19:43.887ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49582024-12-18T22:19:43.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49592024-12-18T22:19:43.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.383101ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49602024-12-18T22:19:43.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49612024-12-18T22:19:43.890ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
49622024-12-18T22:19:43.890ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49632024-12-18T22:19:43.890ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2d931b-2012-42fa-8568-60f1f6746b52", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
49642024-12-18T22:19:43.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49652024-12-18T22:19:43.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
49662024-12-18T22:19:43.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49672024-12-18T22:19:43.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49682024-12-18T22:19:43.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49692024-12-18T22:19:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49702024-12-18T22:19:43.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49712024-12-18T22:19:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49722024-12-18T22:19:43.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.429495ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49732024-12-18T22:19:43.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49742024-12-18T22:19:43.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49752024-12-18T22:19:43.919ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49762024-12-18T22:19:43.919ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49772024-12-18T22:19:43.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.635335ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49782024-12-18T22:19:43.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49792024-12-18T22:19:43.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49802024-12-18T22:19:43.920ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49812024-12-18T22:19:43.920ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97acd763-98ba-4b7e-96b1-4c6c4cdd7e1f", "content-length": "26", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
49822024-12-18T22:19:43.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49832024-12-18T22:19:43.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49842024-12-18T22:19:43.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49852024-12-18T22:19:43.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49862024-12-18T22:19:43.921ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49872024-12-18T22:19:43.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-12-18T22:19:43.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49892024-12-18T22:19:43.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49902024-12-18T22:19:43.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49912024-12-18T22:19:43.987ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.769962ms iteration = 14 status = {"physical_disks_added":0}
49922024-12-18T22:19:43.993ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49932024-12-18T22:19:43.993ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc1c0098-3b21-4bf4-ae17-f9e447426c71", "content-length": "1", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
49942024-12-18T22:19:43.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49952024-12-18T22:19:43.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49962024-12-18T22:19:44.035ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49972024-12-18T22:19:44.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49982024-12-18T22:19:44.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f9d0ed-4a8b-46de-b056-eeb0d3709489", "content-length": "372", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
49992024-12-18T22:19:44.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50002024-12-18T22:19:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50012024-12-18T22:19:44.038ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.16521ms iteration = 12 status = null
50022024-12-18T22:19:44.038ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.761912ms iteration = 12 status = {}
50032024-12-18T22:19:44.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50042024-12-18T22:19:44.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e54f1560-c656-4a48-917e-f354930c965c", "content-length": "691", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50052024-12-18T22:19:44.061ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50062024-12-18T22:19:44.061ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50072024-12-18T22:19:44.061ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50082024-12-18T22:19:44.063ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.183811ms iteration = 12 status = {}
50092024-12-18T22:19:44.077ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50102024-12-18T22:19:44.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50112024-12-18T22:19:44.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f6ea932f-bcf7-49ce-9882-227bdb642729", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50122024-12-18T22:19:44.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50132024-12-18T22:19:44.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50142024-12-18T22:19:44.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50152024-12-18T22:19:44.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50162024-12-18T22:19:44.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50172024-12-18T22:19:44.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50182024-12-18T22:19:44.086ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50192024-12-18T22:19:44.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50202024-12-18T22:19:44.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1d9abff5-a562-479c-9fd1-b11f40cabfeb", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50212024-12-18T22:19:44.089ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.11843ms iteration = 12 status = {}
50222024-12-18T22:19:44.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50232024-12-18T22:19:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50242024-12-18T22:19:44.095ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
50252024-12-18T22:19:44.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50262024-12-18T22:19:44.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50272024-12-18T22:19:44.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50282024-12-18T22:19:44.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c7a21e4-df79-46c1-9ae7-852081628e4e", "content-length": "134", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50292024-12-18T22:19:44.105ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50302024-12-18T22:19:44.105ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
50312024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50322024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50332024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50342024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50352024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50362024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50372024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50382024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50392024-12-18T22:19:44.106ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
50402024-12-18T22:19:44.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50412024-12-18T22:19:44.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50422024-12-18T22:19:44.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50432024-12-18T22:19:44.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1460b6f2-5a36-40d2-971f-f6d7acf93f76", "content-length": "2", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50442024-12-18T22:19:44.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50452024-12-18T22:19:44.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "66ff73b5-8922-4fa2-b5ca-58c2bd85d91e", "content-length": "52", "date": "Wed, 18 Dec 2024 22:19:43 GMT"} })
50462024-12-18T22:19:44.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
50472024-12-18T22:19:44.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50482024-12-18T22:19:44.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c97eccf8-8e60-479b-9a8c-b9200a8dcb36", "date": "Wed, 18 Dec 2024 22:19:44 GMT"} })
50492024-12-18T22:19:44.207ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
50502024-12-18T22:19:44.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50512024-12-18T22:19:44.207ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "775d16c5-b81d-4c96-85da-94e0e3a91864", "content-length": "682", "date": "Wed, 18 Dec 2024 22:19:44 GMT"} })
50522024-12-18T22:19:44.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50532024-12-18T22:19:44.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50542024-12-18T22:19:44.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50552024-12-18T22:19:44.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50562024-12-18T22:19:44.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50572024-12-18T22:19:44.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50582024-12-18T22:19:44.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50592024-12-18T22:19:44.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50602024-12-18T22:19:44.222ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.996176ms iteration = 12 status = {}
50612024-12-18T22:19:44.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 82e80a49-8fde-49cc-b2be-5cd9a0569fdb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50622024-12-18T22:19:44.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 82e80a49-8fde-49cc-b2be-5cd9a0569fdb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50632024-12-18T22:19:44.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 82e80a49-8fde-49cc-b2be-5cd9a0569fdb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50642024-12-18T22:19:45.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7d4d55a-c97a-48e9-a452-ab039a62acc5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50652024-12-18T22:19:45.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7d4d55a-c97a-48e9-a452-ab039a62acc5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50662024-12-18T22:19:45.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7d4d55a-c97a-48e9-a452-ab039a62acc5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50672024-12-18T22:19:46.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 727 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 4d713acd-d651-4391-be55-2a26a7cc29aa response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
50682024-12-18T22:19:46.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eead7adf-516b-4a3c-a34f-e9776cedb17a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50692024-12-18T22:19:46.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eead7adf-516b-4a3c-a34f-e9776cedb17a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50702024-12-18T22:19:46.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = eead7adf-516b-4a3c-a34f-e9776cedb17a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50712024-12-18T22:19:47.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e94a73af-2bb2-48e6-bd7c-db13b56e0104 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50722024-12-18T22:19:47.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e94a73af-2bb2-48e6-bd7c-db13b56e0104 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50732024-12-18T22:19:47.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e94a73af-2bb2-48e6-bd7c-db13b56e0104 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50742024-12-18T22:19:48.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215ad5d9-abef-408a-8460-2d4e12a27072 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50752024-12-18T22:19:48.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215ad5d9-abef-408a-8460-2d4e12a27072 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50762024-12-18T22:19:48.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215ad5d9-abef-408a-8460-2d4e12a27072 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50772024-12-18T22:19:49.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8664ea67-9091-4677-895f-9f05e33d0d6d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50782024-12-18T22:19:49.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8664ea67-9091-4677-895f-9f05e33d0d6d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50792024-12-18T22:19:49.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8664ea67-9091-4677-895f-9f05e33d0d6d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50802024-12-18T22:19:50.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87df36b6-2178-4062-8dd9-d9e2fda2f046 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50812024-12-18T22:19:50.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87df36b6-2178-4062-8dd9-d9e2fda2f046 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50822024-12-18T22:19:50.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87df36b6-2178-4062-8dd9-d9e2fda2f046 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50832024-12-18T22:19:51.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24af9365-f7b9-44e3-bb0b-0ab652fcab92 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50842024-12-18T22:19:51.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24af9365-f7b9-44e3-bb0b-0ab652fcab92 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50852024-12-18T22:19:51.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24af9365-f7b9-44e3-bb0b-0ab652fcab92 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50862024-12-18T22:19:52.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 139c84cc-feb7-4000-9b4b-491a509d8af8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50872024-12-18T22:19:52.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 139c84cc-feb7-4000-9b4b-491a509d8af8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50882024-12-18T22:19:52.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 139c84cc-feb7-4000-9b4b-491a509d8af8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
50892024-12-18T22:19:53.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
50902024-12-18T22:19:53.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50912024-12-18T22:19:53.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
50922024-12-18T22:19:53.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50932024-12-18T22:19:53.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50942024-12-18T22:19:53.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50952024-12-18T22:19:53.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50962024-12-18T22:19:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50972024-12-18T22:19:53.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982024-12-18T22:19:53.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.09315ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50992024-12-18T22:19:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51002024-12-18T22:19:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51012024-12-18T22:19:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51022024-12-18T22:19:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51032024-12-18T22:19:53.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51042024-12-18T22:19:53.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-12-18T22:19:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
51062024-12-18T22:19:53.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51072024-12-18T22:19:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51082024-12-18T22:19:53.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
51092024-12-18T22:19:53.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.883629ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
51102024-12-18T22:19:53.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bce6f82-1fea-4150-9aff-db3fb4ddff1b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51112024-12-18T22:19:53.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bce6f82-1fea-4150-9aff-db3fb4ddff1b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51122024-12-18T22:19:54.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bce6f82-1fea-4150-9aff-db3fb4ddff1b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51132024-12-18T22:19:55.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38094c-7580-4929-98d1-3f8c715fae26 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51142024-12-18T22:19:55.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38094c-7580-4929-98d1-3f8c715fae26 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51152024-12-18T22:19:55.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38094c-7580-4929-98d1-3f8c715fae26 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51162024-12-18T22:19:56.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 66b2de66-81e0-4986-98dd-729506cf6a7a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51172024-12-18T22:19:56.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 66b2de66-81e0-4986-98dd-729506cf6a7a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51182024-12-18T22:19:56.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 66b2de66-81e0-4986-98dd-729506cf6a7a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51192024-12-18T22:19:56.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1ae5be5f-1ba6-4bb3-849b-3f3ed3485cb0 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51202024-12-18T22:19:56.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1ae5be5f-1ba6-4bb3-849b-3f3ed3485cb0 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51212024-12-18T22:19:56.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 1ae5be5f-1ba6-4bb3-849b-3f3ed3485cb0 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51222024-12-18T22:19:56.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = ecb6c9cf-7d52-4f5e-9214-513d539a59cf roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51232024-12-18T22:19:56.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = ecb6c9cf-7d52-4f5e-9214-513d539a59cf resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51242024-12-18T22:19:56.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = ecb6c9cf-7d52-4f5e-9214-513d539a59cf response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51252024-12-18T22:19:56.630ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 66b4f9f2-ee2c-46b8-bd4f-48262ac8009c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
51262024-12-18T22:19:57.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58878aa1-106b-44d5-95a0-39f52d9ead32 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51272024-12-18T22:19:57.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58878aa1-106b-44d5-95a0-39f52d9ead32 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51282024-12-18T22:19:57.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 58878aa1-106b-44d5-95a0-39f52d9ead32 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51292024-12-18T22:19:58.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a7dde2c-ca50-4a97-9258-bf146b2b9f15 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51302024-12-18T22:19:58.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a7dde2c-ca50-4a97-9258-bf146b2b9f15 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51312024-12-18T22:19:58.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a7dde2c-ca50-4a97-9258-bf146b2b9f15 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51322024-12-18T22:19:59.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2333e954-e813-48c5-ac84-439eb09c476a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51332024-12-18T22:19:59.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2333e954-e813-48c5-ac84-439eb09c476a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51342024-12-18T22:19:59.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2333e954-e813-48c5-ac84-439eb09c476a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51352024-12-18T22:20:00.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ac401d6-1a42-4407-bf94-b1dc2e125cf7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51362024-12-18T22:20:00.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ac401d6-1a42-4407-bf94-b1dc2e125cf7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51372024-12-18T22:20:00.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ac401d6-1a42-4407-bf94-b1dc2e125cf7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51382024-12-18T22:20:01.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a47d2bbc-59ba-408f-8da3-102408252c28 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51392024-12-18T22:20:01.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a47d2bbc-59ba-408f-8da3-102408252c28 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51402024-12-18T22:20:01.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a47d2bbc-59ba-408f-8da3-102408252c28 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51412024-12-18T22:20:02.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf21f6ff-a5dc-4fa1-8253-caeaaba740b9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51422024-12-18T22:20:02.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf21f6ff-a5dc-4fa1-8253-caeaaba740b9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51432024-12-18T22:20:02.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bf21f6ff-a5dc-4fa1-8253-caeaaba740b9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51442024-12-18T22:20:03.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b77aefbc-8fef-46fd-a266-14093d895512 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51452024-12-18T22:20:03.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b77aefbc-8fef-46fd-a266-14093d895512 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51462024-12-18T22:20:03.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b77aefbc-8fef-46fd-a266-14093d895512 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51472024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
51482024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51492024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
51502024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51512024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51522024-12-18T22:20:03.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51532024-12-18T22:20:03.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51542024-12-18T22:20:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51552024-12-18T22:20:03.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562024-12-18T22:20:03.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.707373ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51572024-12-18T22:20:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51582024-12-18T22:20:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51592024-12-18T22:20:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51602024-12-18T22:20:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612024-12-18T22:20:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622024-12-18T22:20:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632024-12-18T22:20:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
51642024-12-18T22:20:03.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51652024-12-18T22:20:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51662024-12-18T22:20:03.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
51672024-12-18T22:20:03.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.894741ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
51682024-12-18T22:20:04.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 345de563-6d24-49db-9daf-0bfe6afc3abe roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51692024-12-18T22:20:04.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 345de563-6d24-49db-9daf-0bfe6afc3abe resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51702024-12-18T22:20:04.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 345de563-6d24-49db-9daf-0bfe6afc3abe response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51712024-12-18T22:20:05.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 679ef531-0391-4a90-8dc6-7a9621b6fbc7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51722024-12-18T22:20:05.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 679ef531-0391-4a90-8dc6-7a9621b6fbc7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51732024-12-18T22:20:05.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 679ef531-0391-4a90-8dc6-7a9621b6fbc7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51742024-12-18T22:20:06.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = afa72645-38bd-4d07-be0b-3ab2e21ebec3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51752024-12-18T22:20:06.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = afa72645-38bd-4d07-be0b-3ab2e21ebec3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51762024-12-18T22:20:06.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = afa72645-38bd-4d07-be0b-3ab2e21ebec3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51772024-12-18T22:20:06.631ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 72cb775c-1718-44b3-9c6b-3a52cfb4e5eb response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
51782024-12-18T22:20:07.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f451c3d-3d1d-4616-b83b-e6f88f5bf058 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51792024-12-18T22:20:07.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f451c3d-3d1d-4616-b83b-e6f88f5bf058 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51802024-12-18T22:20:07.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f451c3d-3d1d-4616-b83b-e6f88f5bf058 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51812024-12-18T22:20:08.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ef90a7b-07e1-49a4-9e52-a9d6d5ed5ddb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51822024-12-18T22:20:08.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ef90a7b-07e1-49a4-9e52-a9d6d5ed5ddb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51832024-12-18T22:20:08.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ef90a7b-07e1-49a4-9e52-a9d6d5ed5ddb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51842024-12-18T22:20:09.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 279c5a4e-c69e-4bfd-a08d-cbb1596e35f9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51852024-12-18T22:20:09.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 279c5a4e-c69e-4bfd-a08d-cbb1596e35f9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51862024-12-18T22:20:09.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 279c5a4e-c69e-4bfd-a08d-cbb1596e35f9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51872024-12-18T22:20:10.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f1bd953-72c2-4606-b61e-f2324ea1cf5a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51882024-12-18T22:20:10.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f1bd953-72c2-4606-b61e-f2324ea1cf5a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51892024-12-18T22:20:10.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f1bd953-72c2-4606-b61e-f2324ea1cf5a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51902024-12-18T22:20:11.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8aee580f-c578-40b9-8e07-3756647f4633 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51912024-12-18T22:20:11.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8aee580f-c578-40b9-8e07-3756647f4633 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51922024-12-18T22:20:11.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8aee580f-c578-40b9-8e07-3756647f4633 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
51932024-12-18T22:20:11.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0ded6880-4196-440b-b820-c3024b67328d roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51942024-12-18T22:20:11.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0ded6880-4196-440b-b820-c3024b67328d resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51952024-12-18T22:20:11.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 0ded6880-4196-440b-b820-c3024b67328d response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
51962024-12-18T22:20:11.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 72b1b3cf-25b4-472f-9606-d25efaa911a1 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51972024-12-18T22:20:11.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 72b1b3cf-25b4-472f-9606-d25efaa911a1 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51982024-12-18T22:20:11.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 72b1b3cf-25b4-472f-9606-d25efaa911a1 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
51992024-12-18T22:20:12.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d77e031-4f27-4ec8-9400-5d4851f0ee6e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52002024-12-18T22:20:12.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d77e031-4f27-4ec8-9400-5d4851f0ee6e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52012024-12-18T22:20:12.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d77e031-4f27-4ec8-9400-5d4851f0ee6e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52022024-12-18T22:20:13.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 38fe3be9-6c88-46cb-a7a6-124e457755de roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
52032024-12-18T22:20:13.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 38fe3be9-6c88-46cb-a7a6-124e457755de resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
52042024-12-18T22:20:13.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 38fe3be9-6c88-46cb-a7a6-124e457755de response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52052024-12-18T22:20:13.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9189d064-1454-4bcb-b029-587a5d8b166e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52062024-12-18T22:20:13.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9189d064-1454-4bcb-b029-587a5d8b166e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52072024-12-18T22:20:13.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9189d064-1454-4bcb-b029-587a5d8b166e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
52082024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
52092024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
52102024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
52112024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52122024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52132024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
52142024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
52152024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52162024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52172024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52182024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
52192024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
52202024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52212024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
52222024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52232024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
52242024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
52252024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52262024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52272024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
52282024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52292024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
52302024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52312024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52322024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
52332024-12-18T22:20:13.794ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52342024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
52352024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52362024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52372024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
52382024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52392024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
52402024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52412024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52422024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
52432024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
52442024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52452024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
52462024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
52472024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52482024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52492024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
52502024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
52512024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
52522024-12-18T22:20:13.794ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
52532024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.771\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
52542024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52552024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
52562024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
52572024-12-18T22:20:13.794ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:10:13.794379526 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52582024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52592024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
52602024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52612024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
52622024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52632024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
52642024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52652024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
52662024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52672024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
52682024-12-18T22:20:13.794ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52692024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52702024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
52712024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52722024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52732024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52742024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52752024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52762024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52772024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52782024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52792024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52802024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52812024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52822024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52832024-12-18T22:20:13.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52842024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52852024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52862024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52872024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52882024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52892024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52902024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52912024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52922024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52932024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52942024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52952024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52962024-12-18T22:20:13.795ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 416182365 } })
52972024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52982024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52992024-12-18T22:20:13.795ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 416211046 } })
53002024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53012024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53022024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53032024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53042024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53052024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53062024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53072024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53082024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.501029ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53092024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53102024-12-18T22:20:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.238204ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53112024-12-18T22:20:13.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53122024-12-18T22:20:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.433088ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53132024-12-18T22:20:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53142024-12-18T22:20:13.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53152024-12-18T22:20:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53162024-12-18T22:20:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53172024-12-18T22:20:13.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182024-12-18T22:20:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53192024-12-18T22:20:13.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53202024-12-18T22:20:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53212024-12-18T22:20:13.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53222024-12-18T22:20:13.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53232024-12-18T22:20:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53242024-12-18T22:20:13.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53252024-12-18T22:20:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53262024-12-18T22:20:13.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53272024-12-18T22:20:13.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53282024-12-18T22:20:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53292024-12-18T22:20:13.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302024-12-18T22:20:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53312024-12-18T22:20:13.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53322024-12-18T22:20:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53332024-12-18T22:20:13.805ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.72668ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
53342024-12-18T22:20:13.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53352024-12-18T22:20:13.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53362024-12-18T22:20:13.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53372024-12-18T22:20:13.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53382024-12-18T22:20:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53392024-12-18T22:20:13.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-12-18T22:20:13.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53412024-12-18T22:20:13.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53422024-12-18T22:20:13.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53432024-12-18T22:20:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53442024-12-18T22:20:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53452024-12-18T22:20:13.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53462024-12-18T22:20:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53472024-12-18T22:20:13.812ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:10:13.794379526 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53482024-12-18T22:20:13.812ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.990823ms iteration = 7 status = {"expiration":"2024-12-18T22:10:13.794379526Z","pruned":[]}
53492024-12-18T22:20:13.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 434122087 } })
53502024-12-18T22:20:13.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53512024-12-18T22:20:13.813ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53522024-12-18T22:20:13.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 436761859 } })
53532024-12-18T22:20:13.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53542024-12-18T22:20:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53552024-12-18T22:20:13.816ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53562024-12-18T22:20:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53572024-12-18T22:20:13.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53582024-12-18T22:20:13.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53592024-12-18T22:20:13.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53602024-12-18T22:20:13.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53612024-12-18T22:20:13.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53622024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53632024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53642024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53652024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53662024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53672024-12-18T22:20:13.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53682024-12-18T22:20:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53692024-12-18T22:20:13.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53702024-12-18T22:20:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53712024-12-18T22:20:13.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53722024-12-18T22:20:13.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.801382ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
53732024-12-18T22:20:13.830ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53742024-12-18T22:20:13.830ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.443295ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53752024-12-18T22:20:13.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 451899496 } })
53762024-12-18T22:20:13.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
53772024-12-18T22:20:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53782024-12-18T22:20:13.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53792024-12-18T22:20:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53802024-12-18T22:20:13.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53812024-12-18T22:20:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53822024-12-18T22:20:13.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53832024-12-18T22:20:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53842024-12-18T22:20:13.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852024-12-18T22:20:13.837ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53862024-12-18T22:20:13.837ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53872024-12-18T22:20:13.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53882024-12-18T22:20:13.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.85869ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
53892024-12-18T22:20:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53902024-12-18T22:20:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53912024-12-18T22:20:13.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53922024-12-18T22:20:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53932024-12-18T22:20:13.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-12-18T22:20:13.841ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53952024-12-18T22:20:13.841ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53962024-12-18T22:20:13.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53972024-12-18T22:20:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53982024-12-18T22:20:13.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53992024-12-18T22:20:13.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54002024-12-18T22:20:13.844ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54012024-12-18T22:20:13.844ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54022024-12-18T22:20:13.844ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 50.409979ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54032024-12-18T22:20:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54042024-12-18T22:20:13.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54052024-12-18T22:20:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54062024-12-18T22:20:13.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54072024-12-18T22:20:13.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54082024-12-18T22:20:13.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54092024-12-18T22:20:13.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54102024-12-18T22:20:13.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.691233ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54112024-12-18T22:20:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54122024-12-18T22:20:13.851ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 57.285214ms iteration = 15 status = {"physical_disks_added":0}
54132024-12-18T22:20:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54142024-12-18T22:20:13.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54152024-12-18T22:20:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54162024-12-18T22:20:13.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54172024-12-18T22:20:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54182024-12-18T22:20:13.864ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192024-12-18T22:20:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54202024-12-18T22:20:13.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54212024-12-18T22:20:13.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-12-18T22:20:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54232024-12-18T22:20:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
54242024-12-18T22:20:13.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54252024-12-18T22:20:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54262024-12-18T22:20:13.869ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.120744ms iteration = 4 status = {"nsuccess":5}
54272024-12-18T22:20:13.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.354107ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54282024-12-18T22:20:13.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292024-12-18T22:20:13.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54302024-12-18T22:20:13.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54312024-12-18T22:20:13.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54322024-12-18T22:20:13.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54332024-12-18T22:20:13.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54342024-12-18T22:20:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54352024-12-18T22:20:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54362024-12-18T22:20:13.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54372024-12-18T22:20:13.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54382024-12-18T22:20:13.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-12-18T22:20:13.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54402024-12-18T22:20:13.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54412024-12-18T22:20:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54422024-12-18T22:20:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54432024-12-18T22:20:13.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54442024-12-18T22:20:13.885ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
54452024-12-18T22:20:13.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.810122ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
54462024-12-18T22:20:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54472024-12-18T22:20:13.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.763831ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54482024-12-18T22:20:13.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54492024-12-18T22:20:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54502024-12-18T22:20:13.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.020055ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54512024-12-18T22:20:13.888ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54522024-12-18T22:20:13.888ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54532024-12-18T22:20:13.888ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.585976ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54542024-12-18T22:20:13.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54552024-12-18T22:20:13.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54562024-12-18T22:20:13.893ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54572024-12-18T22:20:13.893ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54582024-12-18T22:20:13.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.248118ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54592024-12-18T22:20:13.907ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54602024-12-18T22:20:13.907ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54612024-12-18T22:20:13.907ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54622024-12-18T22:20:13.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54632024-12-18T22:20:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54642024-12-18T22:20:13.915ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54652024-12-18T22:20:13.915ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54662024-12-18T22:20:13.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54672024-12-18T22:20:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54682024-12-18T22:20:13.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54692024-12-18T22:20:13.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54702024-12-18T22:20:13.971ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54712024-12-18T22:20:13.972ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 177.796558ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54722024-12-18T22:20:13.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54732024-12-18T22:20:13.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54742024-12-18T22:20:13.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8aca318-ff05-4342-aadd-04de0995ff43", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
54752024-12-18T22:20:13.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54762024-12-18T22:20:13.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54772024-12-18T22:20:14.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54782024-12-18T22:20:14.070ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54792024-12-18T22:20:14.070ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54802024-12-18T22:20:14.071ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "25878c8a-d9d5-40e6-8a1b-0cd343984525", "content-length": "372", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
54812024-12-18T22:20:14.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54822024-12-18T22:20:14.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54832024-12-18T22:20:14.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54842024-12-18T22:20:14.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54852024-12-18T22:20:14.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54862024-12-18T22:20:14.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54872024-12-18T22:20:14.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-12-18T22:20:14.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54892024-12-18T22:20:14.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54902024-12-18T22:20:14.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54912024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54922024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54932024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54942024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54952024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54962024-12-18T22:20:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54972024-12-18T22:20:14.079ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54982024-12-18T22:20:14.081ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54992024-12-18T22:20:14.081ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55002024-12-18T22:20:14.081ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
55012024-12-18T22:20:14.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 287.229136ms iteration = 7 status = {"generation":1}
55022024-12-18T22:20:14.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55032024-12-18T22:20:14.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
55042024-12-18T22:20:14.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55052024-12-18T22:20:14.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55062024-12-18T22:20:14.112ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 317.594451ms iteration = 13 status = 0
55072024-12-18T22:20:14.114ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
55082024-12-18T22:20:14.114ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55092024-12-18T22:20:14.114ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 320.377326ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55102024-12-18T22:20:14.114ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
55112024-12-18T22:20:14.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55122024-12-18T22:20:14.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55132024-12-18T22:20:14.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55142024-12-18T22:20:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55152024-12-18T22:20:14.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55162024-12-18T22:20:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55172024-12-18T22:20:14.124ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
55182024-12-18T22:20:14.124ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55192024-12-18T22:20:14.124ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
55202024-12-18T22:20:14.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 329.73343ms iteration = 7 status = {"generation":2}
55212024-12-18T22:20:14.126ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55222024-12-18T22:20:14.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55232024-12-18T22:20:14.126ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ad33672-7bb7-4252-b32e-97e58a3babd2", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
55242024-12-18T22:20:14.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55252024-12-18T22:20:14.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55262024-12-18T22:20:14.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55272024-12-18T22:20:14.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55282024-12-18T22:20:14.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55292024-12-18T22:20:14.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55302024-12-18T22:20:14.135ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55312024-12-18T22:20:14.135ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55322024-12-18T22:20:14.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "126f1489-7fba-47fb-a384-7b3490794bdf", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
55332024-12-18T22:20:14.138ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.02825ms iteration = 13 status = {}
55342024-12-18T22:20:14.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
55352024-12-18T22:20:14.157ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55362024-12-18T22:20:14.157ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f5da8b9-2026-4144-9584-a99a028bbf45", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
55372024-12-18T22:20:14.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55382024-12-18T22:20:14.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
55392024-12-18T22:20:14.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55402024-12-18T22:20:14.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55412024-12-18T22:20:14.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55422024-12-18T22:20:14.193ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55432024-12-18T22:20:14.193ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b23b46f-42a3-45c2-8580-9359153dfd34", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
55442024-12-18T22:20:14.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55452024-12-18T22:20:14.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55462024-12-18T22:20:14.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472024-12-18T22:20:14.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55482024-12-18T22:20:14.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55492024-12-18T22:20:14.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55502024-12-18T22:20:14.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512024-12-18T22:20:14.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55522024-12-18T22:20:14.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55532024-12-18T22:20:14.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55542024-12-18T22:20:14.210ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
55552024-12-18T22:20:14.210ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
55562024-12-18T22:20:14.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55572024-12-18T22:20:14.377ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 583.248164ms iteration = 13 status = {}
55582024-12-18T22:20:14.415ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
55592024-12-18T22:20:14.415ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65487
55602024-12-18T22:20:14.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65487 req_id = 8f27dbcf-2fbc-420a-8aac-af04219a27f9 roles = RoleSet { roles: {} } uri = /metrics/producers
55612024-12-18T22:20:14.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65487 req_id = 8f27dbcf-2fbc-420a-8aac-af04219a27f9 resource = Database result = Ok(()) uri = /metrics/producers
55622024-12-18T22:20:14.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55632024-12-18T22:20:14.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b5b84ce3-3cb3-4acf-a938-0882d2891b7f", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55642024-12-18T22:20:14.427ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55652024-12-18T22:20:14.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b66a8f7e-c24a-42b1-9def-70c70858e6c4", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55662024-12-18T22:20:14.429ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55672024-12-18T22:20:14.431ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55682024-12-18T22:20:14.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 636.859846ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55692024-12-18T22:20:14.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2f14d89e-805b-4feb-bfbf-9f90e8a6cb51 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
55702024-12-18T22:20:14.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2f14d89e-805b-4feb-bfbf-9f90e8a6cb51 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
55712024-12-18T22:20:14.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2f14d89e-805b-4feb-bfbf-9f90e8a6cb51 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
55722024-12-18T22:20:14.456ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
55732024-12-18T22:20:14.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40527 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65487 req_id = 8f27dbcf-2fbc-420a-8aac-af04219a27f9 response_code = 201 uri = /metrics/producers
55742024-12-18T22:20:14.456ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8f27dbcf-2fbc-420a-8aac-af04219a27f9", "content-length": "41", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} })
55752024-12-18T22:20:14.457ZDEBGnexus (producer-registration-task): registered with nexus successfully
55762024-12-18T22:20:14.457ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
55772024-12-18T22:20:14.585ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55782024-12-18T22:20:14.585ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd5253d8-e189-46c4-88a1-e1a359ff9008", "content-length": "1", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
55792024-12-18T22:20:14.587ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55802024-12-18T22:20:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55812024-12-18T22:20:14.589ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 795.149281ms iteration = 13 status = null
55822024-12-18T22:20:14.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55832024-12-18T22:20:14.619ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1194688-a54b-4fbd-a5f9-956c592c64c7", "content-length": "691", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} })
55842024-12-18T22:20:14.619ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55852024-12-18T22:20:14.619ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55862024-12-18T22:20:14.619ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55872024-12-18T22:20:14.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55882024-12-18T22:20:14.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55892024-12-18T22:20:14.620ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 826.135049ms iteration = 13 status = {}
55902024-12-18T22:20:14.621ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55912024-12-18T22:20:14.622ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "90694d89-811f-407b-84cc-a1cf059a223a", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55922024-12-18T22:20:14.622ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55932024-12-18T22:20:14.622ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
55942024-12-18T22:20:14.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55952024-12-18T22:20:14.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55962024-12-18T22:20:14.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "02893f43-4146-4d04-a124-4832bcdcb421", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55972024-12-18T22:20:14.624ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55982024-12-18T22:20:14.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2dcac94e-2769-4d2b-9adc-0d1ab2a127d1", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55992024-12-18T22:20:14.626ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56002024-12-18T22:20:14.628ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
56012024-12-18T22:20:14.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 834.047234ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56022024-12-18T22:20:14.632ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56032024-12-18T22:20:14.632ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9b7a40d-3aac-4fa9-abc9-da7e84f46b41", "content-length": "134", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
56042024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56052024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
56062024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56072024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56082024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56092024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56102024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56112024-12-18T22:20:14.632ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56122024-12-18T22:20:14.633ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56132024-12-18T22:20:14.633ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56142024-12-18T22:20:14.633ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
56152024-12-18T22:20:14.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56162024-12-18T22:20:14.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56172024-12-18T22:20:14.635ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56182024-12-18T22:20:14.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7715375d-9975-4a55-9730-7e071ae56723", "content-length": "2", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
56192024-12-18T22:20:14.635ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56202024-12-18T22:20:14.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b430951-535b-4274-bf6e-b9a6aec8b041", "content-length": "52", "date": "Wed, 18 Dec 2024 22:20:13 GMT"} })
56212024-12-18T22:20:14.635ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
56222024-12-18T22:20:14.635ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56232024-12-18T22:20:14.729ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76bada31-2e3c-4588-aedd-ce87d971fbe3", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} })
56242024-12-18T22:20:14.729ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
56252024-12-18T22:20:14.729ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56262024-12-18T22:20:14.729ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6237152f-5882-40ee-af70-57c99da2f183", "content-length": "682", "date": "Wed, 18 Dec 2024 22:20:14 GMT"} })
56272024-12-18T22:20:14.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56282024-12-18T22:20:14.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56292024-12-18T22:20:14.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56302024-12-18T22:20:14.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56312024-12-18T22:20:14.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56322024-12-18T22:20:14.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56332024-12-18T22:20:14.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56342024-12-18T22:20:14.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56352024-12-18T22:20:14.745ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 951.327055ms iteration = 13 status = {}
56362024-12-18T22:20:15.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f1cec44e-0c5a-4b04-b9a7-14af96659cd0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56372024-12-18T22:20:15.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f1cec44e-0c5a-4b04-b9a7-14af96659cd0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56382024-12-18T22:20:15.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f1cec44e-0c5a-4b04-b9a7-14af96659cd0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56392024-12-18T22:20:16.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69cd36ad-f791-4d31-beb2-f0ea6cdcdf0f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56402024-12-18T22:20:16.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69cd36ad-f791-4d31-beb2-f0ea6cdcdf0f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56412024-12-18T22:20:16.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69cd36ad-f791-4d31-beb2-f0ea6cdcdf0f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56422024-12-18T22:20:16.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = edab7860-6d54-4376-bd87-a4067965cbce response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
56432024-12-18T22:20:17.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c08933f1-6749-4b18-bada-fe638672400e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56442024-12-18T22:20:17.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c08933f1-6749-4b18-bada-fe638672400e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56452024-12-18T22:20:17.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c08933f1-6749-4b18-bada-fe638672400e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56462024-12-18T22:20:18.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a745ab-9146-412f-9228-97c19bb3872e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56472024-12-18T22:20:18.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a745ab-9146-412f-9228-97c19bb3872e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56482024-12-18T22:20:18.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a745ab-9146-412f-9228-97c19bb3872e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56492024-12-18T22:20:19.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d6d34f1-67d6-4606-a51b-c80fe4ac5088 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56502024-12-18T22:20:19.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d6d34f1-67d6-4606-a51b-c80fe4ac5088 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56512024-12-18T22:20:19.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d6d34f1-67d6-4606-a51b-c80fe4ac5088 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56522024-12-18T22:20:20.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f53e7382-1ca3-4903-9dd0-7c696f23ce2d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56532024-12-18T22:20:20.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f53e7382-1ca3-4903-9dd0-7c696f23ce2d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56542024-12-18T22:20:20.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f53e7382-1ca3-4903-9dd0-7c696f23ce2d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56552024-12-18T22:20:21.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a4e528b-6cd4-478a-83e3-9d8ad33e8f2e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56562024-12-18T22:20:21.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a4e528b-6cd4-478a-83e3-9d8ad33e8f2e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56572024-12-18T22:20:21.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4a4e528b-6cd4-478a-83e3-9d8ad33e8f2e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56582024-12-18T22:20:22.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 61b2d4a0-8c23-4fa4-bfc0-d03090a40467 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56592024-12-18T22:20:22.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 61b2d4a0-8c23-4fa4-bfc0-d03090a40467 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56602024-12-18T22:20:22.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 61b2d4a0-8c23-4fa4-bfc0-d03090a40467 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56612024-12-18T22:20:23.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a46026b9-2eb6-4d86-b750-f1df6116ed4f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56622024-12-18T22:20:23.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a46026b9-2eb6-4d86-b750-f1df6116ed4f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56632024-12-18T22:20:23.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a46026b9-2eb6-4d86-b750-f1df6116ed4f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56642024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
56652024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
56662024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56672024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692024-12-18T22:20:23.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56702024-12-18T22:20:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56712024-12-18T22:20:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56722024-12-18T22:20:23.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56732024-12-18T22:20:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56742024-12-18T22:20:23.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56752024-12-18T22:20:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56762024-12-18T22:20:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56772024-12-18T22:20:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
56782024-12-18T22:20:23.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56792024-12-18T22:20:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56802024-12-18T22:20:23.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
56812024-12-18T22:20:23.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.97097ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
56822024-12-18T22:20:23.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56832024-12-18T22:20:23.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56842024-12-18T22:20:23.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.055929ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56852024-12-18T22:20:24.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7a9bdc-fef4-4a2e-b5e8-c7145447091c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56862024-12-18T22:20:24.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7a9bdc-fef4-4a2e-b5e8-c7145447091c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56872024-12-18T22:20:24.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7a9bdc-fef4-4a2e-b5e8-c7145447091c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56882024-12-18T22:20:25.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca2290d6-9c05-422c-9cf9-120abcd51595 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56892024-12-18T22:20:25.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca2290d6-9c05-422c-9cf9-120abcd51595 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56902024-12-18T22:20:25.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca2290d6-9c05-422c-9cf9-120abcd51595 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56912024-12-18T22:20:26.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 545 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = be00de9c-772c-4dd4-84e7-be6919d29ce7 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
56922024-12-18T22:20:26.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 92e66277-7412-4b79-a754-f53e1a04c8bc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56932024-12-18T22:20:26.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 92e66277-7412-4b79-a754-f53e1a04c8bc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56942024-12-18T22:20:26.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 92e66277-7412-4b79-a754-f53e1a04c8bc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56952024-12-18T22:20:27.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0a1a35f7-02ae-4a5a-9eb8-092e6bf88efa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56962024-12-18T22:20:27.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0a1a35f7-02ae-4a5a-9eb8-092e6bf88efa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56972024-12-18T22:20:27.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0a1a35f7-02ae-4a5a-9eb8-092e6bf88efa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56982024-12-18T22:20:28.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e1931b6c-3e67-4d91-85a4-ace927173240 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
56992024-12-18T22:20:28.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e1931b6c-3e67-4d91-85a4-ace927173240 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57002024-12-18T22:20:28.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e1931b6c-3e67-4d91-85a4-ace927173240 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57012024-12-18T22:20:29.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5759090-ddbb-404d-9d0d-b6c255752a6e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57022024-12-18T22:20:29.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5759090-ddbb-404d-9d0d-b6c255752a6e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57032024-12-18T22:20:29.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5759090-ddbb-404d-9d0d-b6c255752a6e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57042024-12-18T22:20:30.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b076276-5d86-4249-94ef-187f6d3a7a1c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57052024-12-18T22:20:30.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b076276-5d86-4249-94ef-187f6d3a7a1c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57062024-12-18T22:20:30.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b076276-5d86-4249-94ef-187f6d3a7a1c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57072024-12-18T22:20:31.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 906b8816-d820-4805-a0d4-4dad098b5ef0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57082024-12-18T22:20:31.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 906b8816-d820-4805-a0d4-4dad098b5ef0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57092024-12-18T22:20:31.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 906b8816-d820-4805-a0d4-4dad098b5ef0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57102024-12-18T22:20:32.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c62fe2a-afce-4439-b730-61378c8ef223 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57112024-12-18T22:20:32.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c62fe2a-afce-4439-b730-61378c8ef223 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57122024-12-18T22:20:32.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8c62fe2a-afce-4439-b730-61378c8ef223 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57132024-12-18T22:20:33.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
57142024-12-18T22:20:33.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57152024-12-18T22:20:33.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
57162024-12-18T22:20:33.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57172024-12-18T22:20:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57182024-12-18T22:20:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57192024-12-18T22:20:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57202024-12-18T22:20:33.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57212024-12-18T22:20:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57222024-12-18T22:20:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57232024-12-18T22:20:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57242024-12-18T22:20:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57252024-12-18T22:20:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57262024-12-18T22:20:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57272024-12-18T22:20:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57282024-12-18T22:20:33.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
57292024-12-18T22:20:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57302024-12-18T22:20:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57312024-12-18T22:20:33.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
57322024-12-18T22:20:33.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.42004ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
57332024-12-18T22:20:33.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.143521ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57342024-12-18T22:20:33.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d646b11-dfed-4000-bf67-4364b70a3c05 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57352024-12-18T22:20:33.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d646b11-dfed-4000-bf67-4364b70a3c05 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57362024-12-18T22:20:33.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9d646b11-dfed-4000-bf67-4364b70a3c05 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57372024-12-18T22:20:34.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db332095-26ef-45e3-a616-d11e4a8c8860 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57382024-12-18T22:20:34.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db332095-26ef-45e3-a616-d11e4a8c8860 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57392024-12-18T22:20:34.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = db332095-26ef-45e3-a616-d11e4a8c8860 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57402024-12-18T22:20:35.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1bfcc87d-a9bd-42f5-ab8f-cc0f0196bf75 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57412024-12-18T22:20:35.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1bfcc87d-a9bd-42f5-ab8f-cc0f0196bf75 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57422024-12-18T22:20:35.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1bfcc87d-a9bd-42f5-ab8f-cc0f0196bf75 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57432024-12-18T22:20:36.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 811 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 6f6589cf-7e41-4e23-b616-32f600aa2207 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
57442024-12-18T22:20:36.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71790830-e80f-41e1-814b-aa6bafb89e5f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57452024-12-18T22:20:36.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71790830-e80f-41e1-814b-aa6bafb89e5f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57462024-12-18T22:20:36.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71790830-e80f-41e1-814b-aa6bafb89e5f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57472024-12-18T22:20:37.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18009823-d230-4154-bfde-0c45b1218188 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57482024-12-18T22:20:37.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18009823-d230-4154-bfde-0c45b1218188 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57492024-12-18T22:20:37.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18009823-d230-4154-bfde-0c45b1218188 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57502024-12-18T22:20:38.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b6e6de-7f92-4ea6-8848-feebe23192e1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57512024-12-18T22:20:38.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b6e6de-7f92-4ea6-8848-feebe23192e1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57522024-12-18T22:20:38.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b6e6de-7f92-4ea6-8848-feebe23192e1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57532024-12-18T22:20:39.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f041e653-4dbc-48a3-8d08-562c8e1f0824 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57542024-12-18T22:20:39.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f041e653-4dbc-48a3-8d08-562c8e1f0824 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57552024-12-18T22:20:39.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f041e653-4dbc-48a3-8d08-562c8e1f0824 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57562024-12-18T22:20:41.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd8d9524-7904-414a-b46a-8d089e5ef415 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57572024-12-18T22:20:41.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd8d9524-7904-414a-b46a-8d089e5ef415 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57582024-12-18T22:20:41.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd8d9524-7904-414a-b46a-8d089e5ef415 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57592024-12-18T22:20:41.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 2a111ec4-c133-4308-bdd7-16b1f12fa3a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
57602024-12-18T22:20:41.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 2a111ec4-c133-4308-bdd7-16b1f12fa3a4 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
57612024-12-18T22:20:41.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 2a111ec4-c133-4308-bdd7-16b1f12fa3a4 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
57622024-12-18T22:20:41.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 24dcd5a6-587e-40d8-b5df-98b6244e6a91 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
57632024-12-18T22:20:41.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 24dcd5a6-587e-40d8-b5df-98b6244e6a91 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
57642024-12-18T22:20:41.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62955 req_id = 24dcd5a6-587e-40d8-b5df-98b6244e6a91 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
57652024-12-18T22:20:42.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6e38410f-95f5-46d9-b813-9a8343704d9f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57662024-12-18T22:20:42.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6e38410f-95f5-46d9-b813-9a8343704d9f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57672024-12-18T22:20:42.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6e38410f-95f5-46d9-b813-9a8343704d9f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57682024-12-18T22:20:43.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683da973-2bc8-4438-b522-8d63de636bcb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57692024-12-18T22:20:43.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683da973-2bc8-4438-b522-8d63de636bcb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57702024-12-18T22:20:43.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683da973-2bc8-4438-b522-8d63de636bcb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
57712024-12-18T22:20:43.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 23abc24f-8510-4b7f-98c0-cac860807eb1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57722024-12-18T22:20:43.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 23abc24f-8510-4b7f-98c0-cac860807eb1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57732024-12-18T22:20:43.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 23abc24f-8510-4b7f-98c0-cac860807eb1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57742024-12-18T22:20:43.794ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
57752024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
57762024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57772024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
57782024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57792024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
57802024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57812024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
57822024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
57832024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
57842024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57852024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57862024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57872024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
57882024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
57892024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57902024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57912024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57922024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
57932024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
57942024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57952024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57962024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
57972024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
57982024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57992024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58002024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
58012024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58022024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
58032024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58042024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
58052024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
58062024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58072024-12-18T22:20:43.795ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58082024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58092024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58102024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58112024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58122024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58132024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58142024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58152024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58162024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58172024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58182024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58192024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58202024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58212024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58222024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58232024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58242024-12-18T22:20:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58252024-12-18T22:20:43.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 418660854 } })
58262024-12-18T22:20:43.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-12-18T22:20:43.798ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58282024-12-18T22:20:43.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.12715ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58292024-12-18T22:20:43.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58302024-12-18T22:20:43.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 419799706 } })
58312024-12-18T22:20:43.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58322024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58332024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58342024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58352024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58362024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58372024-12-18T22:20:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58382024-12-18T22:20:43.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58392024-12-18T22:20:43.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58402024-12-18T22:20:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58412024-12-18T22:20:43.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58422024-12-18T22:20:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58432024-12-18T22:20:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58442024-12-18T22:20:43.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58452024-12-18T22:20:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58462024-12-18T22:20:43.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58472024-12-18T22:20:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58482024-12-18T22:20:43.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 439926951 } })
58492024-12-18T22:20:43.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
58502024-12-18T22:20:43.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.085286ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
58512024-12-18T22:20:43.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.264859ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
58522024-12-18T22:20:43.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-12-18T22:20:43.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58542024-12-18T22:20:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58552024-12-18T22:20:43.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58562024-12-18T22:20:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58572024-12-18T22:20:43.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58582024-12-18T22:20:43.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58592024-12-18T22:20:43.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58602024-12-18T22:20:43.841ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58612024-12-18T22:20:43.841ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58622024-12-18T22:20:43.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58632024-12-18T22:20:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58642024-12-18T22:20:43.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58652024-12-18T22:20:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58662024-12-18T22:20:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58672024-12-18T22:20:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58682024-12-18T22:20:43.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58692024-12-18T22:20:43.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58702024-12-18T22:20:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58712024-12-18T22:20:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58722024-12-18T22:20:43.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.92622ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58732024-12-18T22:20:43.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58742024-12-18T22:20:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58752024-12-18T22:20:43.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.623583ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58762024-12-18T22:20:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.173224ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58772024-12-18T22:20:43.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58782024-12-18T22:20:43.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58792024-12-18T22:20:43.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58802024-12-18T22:20:43.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58812024-12-18T22:20:43.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58822024-12-18T22:20:43.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58832024-12-18T22:20:43.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58842024-12-18T22:20:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58852024-12-18T22:20:43.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-12-18T22:20:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58872024-12-18T22:20:43.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58882024-12-18T22:20:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58892024-12-18T22:20:43.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58902024-12-18T22:20:43.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58912024-12-18T22:20:43.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58922024-12-18T22:20:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
58932024-12-18T22:20:43.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58942024-12-18T22:20:43.879ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b93aab0-9d79-45fe-b2ca-b9334bee3163", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
58952024-12-18T22:20:43.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58962024-12-18T22:20:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58972024-12-18T22:20:43.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-12-18T22:20:43.881ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58992024-12-18T22:20:43.881ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59002024-12-18T22:20:43.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59012024-12-18T22:20:43.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59022024-12-18T22:20:43.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59032024-12-18T22:20:43.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-12-18T22:20:43.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59052024-12-18T22:20:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59062024-12-18T22:20:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
59072024-12-18T22:20:43.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59082024-12-18T22:20:43.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59092024-12-18T22:20:43.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59102024-12-18T22:20:43.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59112024-12-18T22:20:43.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59122024-12-18T22:20:43.886ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.510886ms iteration = 14 status = 0
59132024-12-18T22:20:43.892ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59142024-12-18T22:20:43.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.32736ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59152024-12-18T22:20:43.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59162024-12-18T22:20:43.894ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59172024-12-18T22:20:43.895ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42dbfc65-7d37-490f-89f6-45f2d299eb81", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59182024-12-18T22:20:43.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59192024-12-18T22:20:43.896ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
59202024-12-18T22:20:43.896ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.202886ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
59212024-12-18T22:20:43.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59222024-12-18T22:20:43.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
59232024-12-18T22:20:43.912ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59242024-12-18T22:20:43.912ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0f4cff7-39d1-4723-b473-4d0385d1531b", "content-length": "26", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59252024-12-18T22:20:43.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59262024-12-18T22:20:43.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
59272024-12-18T22:20:43.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.560365ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59282024-12-18T22:20:43.924ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59292024-12-18T22:20:43.924ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59302024-12-18T22:20:43.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.464601ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59312024-12-18T22:20:43.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59322024-12-18T22:20:43.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59332024-12-18T22:20:43.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59342024-12-18T22:20:43.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59352024-12-18T22:20:43.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59362024-12-18T22:20:43.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59372024-12-18T22:20:43.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382024-12-18T22:20:43.959ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.377365ms iteration = 16 status = {"physical_disks_added":0}
59392024-12-18T22:20:43.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59402024-12-18T22:20:43.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59412024-12-18T22:20:43.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59422024-12-18T22:20:43.967ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59432024-12-18T22:20:43.967ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "65cae0fa-d0ee-45a8-aa6f-e80e6f46fe88", "content-length": "1", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59442024-12-18T22:20:43.969ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59452024-12-18T22:20:43.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59462024-12-18T22:20:43.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.337713ms iteration = 14 status = {}
59472024-12-18T22:20:44.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5bc09c4-2425-43d9-b4fe-e4e1cb65d1f3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
59482024-12-18T22:20:44.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5bc09c4-2425-43d9-b4fe-e4e1cb65d1f3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
59492024-12-18T22:20:44.100ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59502024-12-18T22:20:44.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59512024-12-18T22:20:44.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ea32a34-28a9-43f3-953c-6792e9db5eb0", "content-length": "372", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
59522024-12-18T22:20:44.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59532024-12-18T22:20:44.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59542024-12-18T22:20:44.102ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.34676ms iteration = 14 status = null
59552024-12-18T22:20:44.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5bc09c4-2425-43d9-b4fe-e4e1cb65d1f3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
59562024-12-18T22:20:44.114ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59572024-12-18T22:20:44.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59582024-12-18T22:20:44.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ae21c314-03ef-4ebb-abcf-a1cffb5c73a7", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
59592024-12-18T22:20:44.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59602024-12-18T22:20:44.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59612024-12-18T22:20:44.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59622024-12-18T22:20:44.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59632024-12-18T22:20:44.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59642024-12-18T22:20:44.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59652024-12-18T22:20:44.122ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59662024-12-18T22:20:44.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59672024-12-18T22:20:44.123ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c40a03a4-1304-4340-9a06-fb72be0ee905", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
59682024-12-18T22:20:44.125ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 330.175698ms iteration = 14 status = {}
59692024-12-18T22:20:44.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59702024-12-18T22:20:44.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59712024-12-18T22:20:44.153ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
59722024-12-18T22:20:44.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59732024-12-18T22:20:44.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59742024-12-18T22:20:44.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59752024-12-18T22:20:44.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e52e56b-cc4f-49f8-8829-63e8167603c0", "content-length": "134", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59762024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59772024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
59782024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59792024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59802024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59812024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59822024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59832024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59842024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59852024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59862024-12-18T22:20:44.163ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
59872024-12-18T22:20:44.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59882024-12-18T22:20:44.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59892024-12-18T22:20:44.183ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59902024-12-18T22:20:44.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "caf2e6bd-4c08-42f7-9f0b-4e1af9ca9eec", "content-length": "691", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
59912024-12-18T22:20:44.183ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59922024-12-18T22:20:44.183ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59932024-12-18T22:20:44.183ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59942024-12-18T22:20:44.184ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.237897ms iteration = 14 status = {}
59952024-12-18T22:20:44.184ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59962024-12-18T22:20:44.185ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec2ede1c-56f7-4f6e-9353-ecbe5bdfdab2", "content-length": "2", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59972024-12-18T22:20:44.185ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59982024-12-18T22:20:44.185ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b6bb040-00a9-4dcb-b41d-e5cefff6161d", "content-length": "52", "date": "Wed, 18 Dec 2024 22:20:43 GMT"} })
59992024-12-18T22:20:44.185ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
60002024-12-18T22:20:44.185ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60012024-12-18T22:20:44.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11b736c7-e662-45ad-af34-a7a80e9292f5", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
60022024-12-18T22:20:44.277ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
60032024-12-18T22:20:44.277ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60042024-12-18T22:20:44.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bab2a44-4e06-4d0b-a5ef-e472ada20d24", "content-length": "682", "date": "Wed, 18 Dec 2024 22:20:44 GMT"} })
60052024-12-18T22:20:44.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60062024-12-18T22:20:44.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60072024-12-18T22:20:44.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60082024-12-18T22:20:44.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60092024-12-18T22:20:44.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60102024-12-18T22:20:44.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60112024-12-18T22:20:44.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60122024-12-18T22:20:44.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60132024-12-18T22:20:44.294ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.687444ms iteration = 14 status = {}
60142024-12-18T22:20:45.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5963ea56-c2ef-46de-9b0a-e80d7a47830c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60152024-12-18T22:20:45.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5963ea56-c2ef-46de-9b0a-e80d7a47830c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60162024-12-18T22:20:45.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5963ea56-c2ef-46de-9b0a-e80d7a47830c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60172024-12-18T22:20:46.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98c724a7-b800-47d7-bcb4-8d5b860d2e40 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60182024-12-18T22:20:46.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98c724a7-b800-47d7-bcb4-8d5b860d2e40 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60192024-12-18T22:20:46.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 98c724a7-b800-47d7-bcb4-8d5b860d2e40 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60202024-12-18T22:20:46.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 158c084a-de55-4b4c-9fcb-5f4219d2257c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
60212024-12-18T22:20:47.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb0d3051-aa5f-45a9-8c2d-a73ed408017b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60222024-12-18T22:20:47.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb0d3051-aa5f-45a9-8c2d-a73ed408017b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60232024-12-18T22:20:47.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb0d3051-aa5f-45a9-8c2d-a73ed408017b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60242024-12-18T22:20:48.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fb7e593d-f4d6-47b5-ac7f-80f8d9f300e4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60252024-12-18T22:20:48.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fb7e593d-f4d6-47b5-ac7f-80f8d9f300e4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60262024-12-18T22:20:48.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fb7e593d-f4d6-47b5-ac7f-80f8d9f300e4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60272024-12-18T22:20:49.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 217311fe-cc9d-4130-bb1e-968ad03254dd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60282024-12-18T22:20:49.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 217311fe-cc9d-4130-bb1e-968ad03254dd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60292024-12-18T22:20:49.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 217311fe-cc9d-4130-bb1e-968ad03254dd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60302024-12-18T22:20:50.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70e4096-d031-49e2-9205-7e9b368109b8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60312024-12-18T22:20:50.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70e4096-d031-49e2-9205-7e9b368109b8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60322024-12-18T22:20:50.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e70e4096-d031-49e2-9205-7e9b368109b8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60332024-12-18T22:20:51.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bfe44923-d0ac-4ddb-9d12-77fd9145df0b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60342024-12-18T22:20:51.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bfe44923-d0ac-4ddb-9d12-77fd9145df0b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60352024-12-18T22:20:51.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bfe44923-d0ac-4ddb-9d12-77fd9145df0b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60362024-12-18T22:20:52.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e79198-1f1f-4b2c-835d-f3277e973397 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60372024-12-18T22:20:52.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e79198-1f1f-4b2c-835d-f3277e973397 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60382024-12-18T22:20:52.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 75e79198-1f1f-4b2c-835d-f3277e973397 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60392024-12-18T22:20:53.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d55ad4f1-dfc0-4e94-8526-ce4116d88bed roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60402024-12-18T22:20:53.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d55ad4f1-dfc0-4e94-8526-ce4116d88bed resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60412024-12-18T22:20:53.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d55ad4f1-dfc0-4e94-8526-ce4116d88bed response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60422024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
60432024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60442024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
60452024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60462024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60472024-12-18T22:20:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60482024-12-18T22:20:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60492024-12-18T22:20:53.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60502024-12-18T22:20:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60512024-12-18T22:20:53.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60522024-12-18T22:20:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60532024-12-18T22:20:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60542024-12-18T22:20:53.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60552024-12-18T22:20:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
60562024-12-18T22:20:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60572024-12-18T22:20:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60582024-12-18T22:20:53.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
60592024-12-18T22:20:53.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.623384ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
60602024-12-18T22:20:53.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60612024-12-18T22:20:53.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60622024-12-18T22:20:53.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.603959ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60632024-12-18T22:20:54.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1e487e-23e0-4340-a1f6-7f71cbd9d4f5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60642024-12-18T22:20:54.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1e487e-23e0-4340-a1f6-7f71cbd9d4f5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60652024-12-18T22:20:54.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1e487e-23e0-4340-a1f6-7f71cbd9d4f5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60662024-12-18T22:20:55.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0dcdf7d1-7ebf-40e9-ae00-4a1d354b061b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60672024-12-18T22:20:55.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0dcdf7d1-7ebf-40e9-ae00-4a1d354b061b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60682024-12-18T22:20:55.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0dcdf7d1-7ebf-40e9-ae00-4a1d354b061b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60692024-12-18T22:20:56.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df917944-b794-40f2-8212-0e9569fb7bf5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60702024-12-18T22:20:56.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df917944-b794-40f2-8212-0e9569fb7bf5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60712024-12-18T22:20:56.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df917944-b794-40f2-8212-0e9569fb7bf5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60722024-12-18T22:20:56.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 98538830-09ea-4afa-832e-4374f66299d8 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
60732024-12-18T22:20:57.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e31c2ef6-bd86-4b98-9c0c-f95613722bc6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60742024-12-18T22:20:57.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e31c2ef6-bd86-4b98-9c0c-f95613722bc6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60752024-12-18T22:20:57.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e31c2ef6-bd86-4b98-9c0c-f95613722bc6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60762024-12-18T22:20:58.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 137761d1-8250-4ce5-972e-1041ee3acfa7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60772024-12-18T22:20:58.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 137761d1-8250-4ce5-972e-1041ee3acfa7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60782024-12-18T22:20:58.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 137761d1-8250-4ce5-972e-1041ee3acfa7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60792024-12-18T22:20:59.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f68758c-de7c-41a4-95f4-0baa18b4428f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60802024-12-18T22:20:59.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f68758c-de7c-41a4-95f4-0baa18b4428f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60812024-12-18T22:20:59.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0f68758c-de7c-41a4-95f4-0baa18b4428f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60822024-12-18T22:21:00.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56092343-3cad-418f-8d37-5b3d1304d64d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60832024-12-18T22:21:00.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56092343-3cad-418f-8d37-5b3d1304d64d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60842024-12-18T22:21:00.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 56092343-3cad-418f-8d37-5b3d1304d64d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60852024-12-18T22:21:01.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6beb429c-5ec3-45d8-b58d-84c69a284fd7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60862024-12-18T22:21:01.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6beb429c-5ec3-45d8-b58d-84c69a284fd7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60872024-12-18T22:21:01.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6beb429c-5ec3-45d8-b58d-84c69a284fd7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60882024-12-18T22:21:02.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e86044f3-5c9b-4d67-89be-7e78c9891d91 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60892024-12-18T22:21:02.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e86044f3-5c9b-4d67-89be-7e78c9891d91 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60902024-12-18T22:21:02.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e86044f3-5c9b-4d67-89be-7e78c9891d91 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60912024-12-18T22:21:03.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c1b044f1-9c27-416d-aa69-35198a2654c0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60922024-12-18T22:21:03.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c1b044f1-9c27-416d-aa69-35198a2654c0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60932024-12-18T22:21:03.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c1b044f1-9c27-416d-aa69-35198a2654c0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
60942024-12-18T22:21:03.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
60952024-12-18T22:21:03.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
60962024-12-18T22:21:03.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60972024-12-18T22:21:03.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60982024-12-18T22:21:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60992024-12-18T22:21:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61002024-12-18T22:21:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61012024-12-18T22:21:03.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61022024-12-18T22:21:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61032024-12-18T22:21:03.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61042024-12-18T22:21:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61052024-12-18T22:21:03.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61062024-12-18T22:21:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072024-12-18T22:21:03.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
61082024-12-18T22:21:03.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61092024-12-18T22:21:03.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61102024-12-18T22:21:03.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
61112024-12-18T22:21:03.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.568423ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
61122024-12-18T22:21:03.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61132024-12-18T22:21:03.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61142024-12-18T22:21:03.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.623211ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61152024-12-18T22:21:04.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 067a5d54-b4c4-4ccd-a869-79b0ba600d38 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61162024-12-18T22:21:04.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 067a5d54-b4c4-4ccd-a869-79b0ba600d38 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61172024-12-18T22:21:04.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 067a5d54-b4c4-4ccd-a869-79b0ba600d38 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61182024-12-18T22:21:05.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1575ac16-8b46-4b1d-b1a7-d331729350ab roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61192024-12-18T22:21:05.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1575ac16-8b46-4b1d-b1a7-d331729350ab resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61202024-12-18T22:21:05.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1575ac16-8b46-4b1d-b1a7-d331729350ab response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61212024-12-18T22:21:06.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 772c87e4-6fa9-4a00-abd6-4ef474fe723f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61222024-12-18T22:21:06.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 772c87e4-6fa9-4a00-abd6-4ef474fe723f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61232024-12-18T22:21:06.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 772c87e4-6fa9-4a00-abd6-4ef474fe723f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61242024-12-18T22:21:06.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 88d323f5-78fb-47b3-bfcd-f5c490231440 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
61252024-12-18T22:21:07.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8c55925-18ea-4f2b-a09c-f7efd63ee7f1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61262024-12-18T22:21:07.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8c55925-18ea-4f2b-a09c-f7efd63ee7f1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61272024-12-18T22:21:07.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8c55925-18ea-4f2b-a09c-f7efd63ee7f1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61282024-12-18T22:21:08.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69337227-8d64-402d-b862-880e1b88de1b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61292024-12-18T22:21:08.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69337227-8d64-402d-b862-880e1b88de1b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61302024-12-18T22:21:08.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 69337227-8d64-402d-b862-880e1b88de1b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61312024-12-18T22:21:09.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c970c609-edf7-484a-ba08-1c24d90026a5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61322024-12-18T22:21:09.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c970c609-edf7-484a-ba08-1c24d90026a5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61332024-12-18T22:21:09.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c970c609-edf7-484a-ba08-1c24d90026a5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61342024-12-18T22:21:10.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5829f6d-70fe-4f08-b387-aab4d082e27a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61352024-12-18T22:21:10.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5829f6d-70fe-4f08-b387-aab4d082e27a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61362024-12-18T22:21:10.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c5829f6d-70fe-4f08-b387-aab4d082e27a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61372024-12-18T22:21:11.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4182dcd-c9b8-4dd8-9ba2-e05dc62a0f4d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61382024-12-18T22:21:11.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4182dcd-c9b8-4dd8-9ba2-e05dc62a0f4d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61392024-12-18T22:21:11.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4182dcd-c9b8-4dd8-9ba2-e05dc62a0f4d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61402024-12-18T22:21:12.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2821af74-86f2-4767-9b9c-01b87e0d18d1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61412024-12-18T22:21:12.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2821af74-86f2-4767-9b9c-01b87e0d18d1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61422024-12-18T22:21:12.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2821af74-86f2-4767-9b9c-01b87e0d18d1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61432024-12-18T22:21:13.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2399b804-3fbb-416e-bcc8-174b3c24023d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61442024-12-18T22:21:13.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2399b804-3fbb-416e-bcc8-174b3c24023d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61452024-12-18T22:21:13.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2399b804-3fbb-416e-bcc8-174b3c24023d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61462024-12-18T22:21:13.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe5c084-130b-4d38-a132-3ada122b3898 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61472024-12-18T22:21:13.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe5c084-130b-4d38-a132-3ada122b3898 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61482024-12-18T22:21:13.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe5c084-130b-4d38-a132-3ada122b3898 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
61492024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
61502024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61512024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
61522024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61532024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
61542024-12-18T22:21:13.795ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:11:13.795096764 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61552024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61562024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61572024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
61582024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
61592024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
61602024-12-18T22:21:13.795ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
61612024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61622024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
61632024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.64\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
61642024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
61652024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
61662024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61672024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
61682024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61692024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61702024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61712024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
61722024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61732024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
61742024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61752024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61762024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
61772024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
61782024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61792024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
61802024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
61812024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
61822024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61832024-12-18T22:21:13.795ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61842024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61852024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
61862024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61872024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
61882024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
61892024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
61902024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61912024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
61922024-12-18T22:21:13.795ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61932024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
61942024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61952024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61962024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
61972024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
61982024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61992024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62002024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62012024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62022024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
62032024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62042024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
62052024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62062024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
62072024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62082024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62092024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
62102024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
62112024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62122024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62132024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62142024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62152024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62162024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62172024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62182024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62192024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62202024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62212024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62222024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62232024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62242024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62252024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62262024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62272024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62282024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62292024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62302024-12-18T22:21:13.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62312024-12-18T22:21:13.795ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 416086573 } })
62322024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62332024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62342024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62352024-12-18T22:21:13.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 416132224 } })
62362024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62372024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62382024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.197054ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62392024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62402024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.218854ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62412024-12-18T22:21:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62422024-12-18T22:21:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62432024-12-18T22:21:13.797ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:11:13.795096764 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62442024-12-18T22:21:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.790635ms iteration = 8 status = {"expiration":"2024-12-18T22:11:13.795096764Z","pruned":[]}
62452024-12-18T22:21:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.289105ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62462024-12-18T22:21:13.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62472024-12-18T22:21:13.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 420163553 } })
62482024-12-18T22:21:13.800ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62492024-12-18T22:21:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62502024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62512024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62522024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62532024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62542024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62552024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62562024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62572024-12-18T22:21:13.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62582024-12-18T22:21:13.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592024-12-18T22:21:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62602024-12-18T22:21:13.803ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62612024-12-18T22:21:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62622024-12-18T22:21:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62632024-12-18T22:21:13.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62642024-12-18T22:21:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62652024-12-18T22:21:13.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62662024-12-18T22:21:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62672024-12-18T22:21:13.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62682024-12-18T22:21:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62692024-12-18T22:21:13.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.551537ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
62702024-12-18T22:21:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62712024-12-18T22:21:13.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62722024-12-18T22:21:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62732024-12-18T22:21:13.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742024-12-18T22:21:13.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 429055137 } })
62752024-12-18T22:21:13.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62762024-12-18T22:21:13.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62772024-12-18T22:21:13.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62782024-12-18T22:21:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62792024-12-18T22:21:13.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-12-18T22:21:13.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812024-12-18T22:21:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62822024-12-18T22:21:13.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62832024-12-18T22:21:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62842024-12-18T22:21:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62852024-12-18T22:21:13.818ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62862024-12-18T22:21:13.818ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62872024-12-18T22:21:13.818ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62882024-12-18T22:21:13.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62892024-12-18T22:21:13.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62902024-12-18T22:21:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62912024-12-18T22:21:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62922024-12-18T22:21:13.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62932024-12-18T22:21:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62942024-12-18T22:21:13.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62952024-12-18T22:21:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62962024-12-18T22:21:13.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62972024-12-18T22:21:13.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62982024-12-18T22:21:13.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62992024-12-18T22:21:13.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63002024-12-18T22:21:13.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63012024-12-18T22:21:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63022024-12-18T22:21:13.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 446773305 } })
63032024-12-18T22:21:13.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
63042024-12-18T22:21:13.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052024-12-18T22:21:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63062024-12-18T22:21:13.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63072024-12-18T22:21:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63082024-12-18T22:21:13.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092024-12-18T22:21:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
63102024-12-18T22:21:13.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63112024-12-18T22:21:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63122024-12-18T22:21:13.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63132024-12-18T22:21:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63142024-12-18T22:21:13.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.952538ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
63152024-12-18T22:21:13.851ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63162024-12-18T22:21:13.851ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63172024-12-18T22:21:13.851ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.703522ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63182024-12-18T22:21:13.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.721432ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63192024-12-18T22:21:13.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-12-18T22:21:13.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63212024-12-18T22:21:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63222024-12-18T22:21:13.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63232024-12-18T22:21:13.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63242024-12-18T22:21:13.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63252024-12-18T22:21:13.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63262024-12-18T22:21:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63272024-12-18T22:21:13.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
63282024-12-18T22:21:13.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.472324ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
63292024-12-18T22:21:13.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63302024-12-18T22:21:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63312024-12-18T22:21:13.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-12-18T22:21:13.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63332024-12-18T22:21:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63342024-12-18T22:21:13.865ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63352024-12-18T22:21:13.865ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63362024-12-18T22:21:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.193337ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63372024-12-18T22:21:13.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.082964ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
63382024-12-18T22:21:13.866ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63392024-12-18T22:21:13.866ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63402024-12-18T22:21:13.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63412024-12-18T22:21:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63422024-12-18T22:21:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63432024-12-18T22:21:13.867ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63442024-12-18T22:21:13.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.577654ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63452024-12-18T22:21:13.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63462024-12-18T22:21:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63472024-12-18T22:21:13.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-12-18T22:21:13.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63492024-12-18T22:21:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63502024-12-18T22:21:13.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63512024-12-18T22:21:13.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63522024-12-18T22:21:13.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 75.634204ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63532024-12-18T22:21:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63542024-12-18T22:21:13.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63552024-12-18T22:21:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63562024-12-18T22:21:13.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.105453ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63572024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63582024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63592024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
63602024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63612024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63622024-12-18T22:21:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63632024-12-18T22:21:13.875ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.430948ms iteration = 15 status = 0
63642024-12-18T22:21:13.876ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63652024-12-18T22:21:13.876ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
63662024-12-18T22:21:13.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63672024-12-18T22:21:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63682024-12-18T22:21:13.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63692024-12-18T22:21:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63702024-12-18T22:21:13.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63712024-12-18T22:21:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63722024-12-18T22:21:13.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
63732024-12-18T22:21:13.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63742024-12-18T22:21:13.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
63752024-12-18T22:21:13.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 87.017617ms iteration = 8 status = {"generation":2}
63762024-12-18T22:21:13.896ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63772024-12-18T22:21:13.896ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63782024-12-18T22:21:13.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63792024-12-18T22:21:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63802024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63812024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63822024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63832024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63842024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.721235ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63852024-12-18T22:21:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63862024-12-18T22:21:13.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63872024-12-18T22:21:13.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63882024-12-18T22:21:13.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63892024-12-18T22:21:13.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63902024-12-18T22:21:13.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63912024-12-18T22:21:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63922024-12-18T22:21:13.920ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63932024-12-18T22:21:13.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 125.636105ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63942024-12-18T22:21:13.929ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63952024-12-18T22:21:13.929ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63962024-12-18T22:21:13.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.816525ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63972024-12-18T22:21:13.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63982024-12-18T22:21:13.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63992024-12-18T22:21:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64002024-12-18T22:21:13.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64012024-12-18T22:21:13.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64022024-12-18T22:21:13.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64032024-12-18T22:21:13.947ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
64042024-12-18T22:21:13.947ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 152.579014ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64052024-12-18T22:21:13.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.963551ms iteration = 17 status = {"physical_disks_added":0}
64062024-12-18T22:21:13.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64072024-12-18T22:21:13.962ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64082024-12-18T22:21:13.963ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "24fc6e9b-05af-498b-b2a6-9e348131d42c", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:13 GMT"} })
64092024-12-18T22:21:13.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64102024-12-18T22:21:13.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64112024-12-18T22:21:13.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64122024-12-18T22:21:13.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
64132024-12-18T22:21:13.977ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64142024-12-18T22:21:13.977ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1838d1ba-a43e-4da4-bb82-93681b1bb252", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:13 GMT"} })
64152024-12-18T22:21:13.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64162024-12-18T22:21:13.979ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
64172024-12-18T22:21:14.067ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64182024-12-18T22:21:14.099ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64192024-12-18T22:21:14.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64202024-12-18T22:21:14.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee201f6-9be9-40b8-aace-db2dc50ae15c", "content-length": "372", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64212024-12-18T22:21:14.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64222024-12-18T22:21:14.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64232024-12-18T22:21:14.102ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64242024-12-18T22:21:14.102ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64252024-12-18T22:21:14.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64262024-12-18T22:21:14.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64272024-12-18T22:21:14.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64282024-12-18T22:21:14.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64292024-12-18T22:21:14.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64302024-12-18T22:21:14.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64312024-12-18T22:21:14.111ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64322024-12-18T22:21:14.111ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64332024-12-18T22:21:14.111ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
64342024-12-18T22:21:14.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 316.397988ms iteration = 8 status = {"generation":1}
64352024-12-18T22:21:14.116ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64362024-12-18T22:21:14.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64372024-12-18T22:21:14.116ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc5b75d8-ba3e-45ee-859b-ce1cdc52f4a4", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64382024-12-18T22:21:14.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64392024-12-18T22:21:14.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64402024-12-18T22:21:14.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64412024-12-18T22:21:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64422024-12-18T22:21:14.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64432024-12-18T22:21:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64442024-12-18T22:21:14.124ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64452024-12-18T22:21:14.124ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64462024-12-18T22:21:14.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "61c5a6b3-b739-40b1-80c7-679b648d4ce7", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64472024-12-18T22:21:14.126ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.323951ms iteration = 15 status = {}
64482024-12-18T22:21:14.128ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.557035ms iteration = 15 status = {}
64492024-12-18T22:21:14.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64502024-12-18T22:21:14.132ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64512024-12-18T22:21:14.132ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab01db04-f417-4fd6-b2ad-bdd6884d43e8", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:13 GMT"} })
64522024-12-18T22:21:14.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64532024-12-18T22:21:14.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64542024-12-18T22:21:14.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64552024-12-18T22:21:14.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64562024-12-18T22:21:14.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64572024-12-18T22:21:14.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64582024-12-18T22:21:14.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64592024-12-18T22:21:14.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64602024-12-18T22:21:14.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64612024-12-18T22:21:14.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64622024-12-18T22:21:14.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64632024-12-18T22:21:14.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64642024-12-18T22:21:14.145ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64652024-12-18T22:21:14.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "21e331ca-7274-40a7-ad64-80aabfa0d574", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64662024-12-18T22:21:14.145ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64672024-12-18T22:21:14.146ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ab2f08b1-fce1-46ed-8a4c-fda9d3a3e8de", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64682024-12-18T22:21:14.146ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64692024-12-18T22:21:14.148ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64702024-12-18T22:21:14.148ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 353.584207ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64712024-12-18T22:21:14.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64722024-12-18T22:21:14.256ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64732024-12-18T22:21:14.256ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a969d630-d8f3-42cb-95b2-2f8ac32d55f9", "content-length": "1", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64742024-12-18T22:21:14.258ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64752024-12-18T22:21:14.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64762024-12-18T22:21:14.259ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.776059ms iteration = 15 status = null
64772024-12-18T22:21:14.270ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64782024-12-18T22:21:14.270ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecdb154e-837d-4d67-bf9e-0ad9ad29f142", "content-length": "691", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64792024-12-18T22:21:14.270ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64802024-12-18T22:21:14.270ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64812024-12-18T22:21:14.270ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64822024-12-18T22:21:14.271ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 476.373236ms iteration = 15 status = {}
64832024-12-18T22:21:14.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64842024-12-18T22:21:14.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1e4ff401-1c71-4675-9447-3df134636284", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64852024-12-18T22:21:14.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64862024-12-18T22:21:14.311ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ef448fb4-6d98-4b27-8271-0afe14a034cd", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64872024-12-18T22:21:14.311ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64882024-12-18T22:21:14.313ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a3c8da3e-3366-45af-94bd-30bec4b4f775", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64892024-12-18T22:21:14.313ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64902024-12-18T22:21:14.315ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
64912024-12-18T22:21:14.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.361289ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64922024-12-18T22:21:14.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64932024-12-18T22:21:14.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64942024-12-18T22:21:14.325ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
64952024-12-18T22:21:14.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64962024-12-18T22:21:14.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64972024-12-18T22:21:14.334ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64982024-12-18T22:21:14.334ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8762c4-8ca7-490b-b55b-6ae113f65c6c", "content-length": "134", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
64992024-12-18T22:21:14.334ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65002024-12-18T22:21:14.334ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
65012024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65022024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65032024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65042024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65052024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65062024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65072024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65082024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65092024-12-18T22:21:14.335ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
65102024-12-18T22:21:14.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65112024-12-18T22:21:14.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65122024-12-18T22:21:14.337ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65132024-12-18T22:21:14.337ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c59eab-9c16-4e6e-a0b4-bada527bc168", "content-length": "2", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
65142024-12-18T22:21:14.337ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65152024-12-18T22:21:14.337ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f7577a0-6911-4834-afd8-49e78f9b4a04", "content-length": "52", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
65162024-12-18T22:21:14.337ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
65172024-12-18T22:21:14.337ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65182024-12-18T22:21:14.434ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4ae856f4-09b1-44c4-89c3-ab6e24315909", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
65192024-12-18T22:21:14.434ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
65202024-12-18T22:21:14.434ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65212024-12-18T22:21:14.434ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a316b8-ff4e-4265-bdab-735799b11fae", "content-length": "682", "date": "Wed, 18 Dec 2024 22:21:14 GMT"} })
65222024-12-18T22:21:14.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65232024-12-18T22:21:14.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65242024-12-18T22:21:14.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65252024-12-18T22:21:14.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65262024-12-18T22:21:14.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65272024-12-18T22:21:14.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65282024-12-18T22:21:14.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65292024-12-18T22:21:14.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65302024-12-18T22:21:14.451ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 656.48476ms iteration = 15 status = {}
65312024-12-18T22:21:14.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cd3b3ccf-e685-4087-ab9b-2aacfc68a1e3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65322024-12-18T22:21:14.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cd3b3ccf-e685-4087-ab9b-2aacfc68a1e3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65332024-12-18T22:21:14.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cd3b3ccf-e685-4087-ab9b-2aacfc68a1e3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65342024-12-18T22:21:15.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45398eb9-e944-42ce-958e-fda92857bdd2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65352024-12-18T22:21:15.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45398eb9-e944-42ce-958e-fda92857bdd2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65362024-12-18T22:21:15.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45398eb9-e944-42ce-958e-fda92857bdd2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65372024-12-18T22:21:16.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 94e5fc70-8676-43b8-8346-6480fc26edac response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
65382024-12-18T22:21:16.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b01ee2a6-e12d-4c1a-959a-071ce0b12287 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65392024-12-18T22:21:16.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b01ee2a6-e12d-4c1a-959a-071ce0b12287 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65402024-12-18T22:21:16.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b01ee2a6-e12d-4c1a-959a-071ce0b12287 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65412024-12-18T22:21:17.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f8812de-f3f4-46c4-96e3-f3b7af5e1ba0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65422024-12-18T22:21:17.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f8812de-f3f4-46c4-96e3-f3b7af5e1ba0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65432024-12-18T22:21:17.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f8812de-f3f4-46c4-96e3-f3b7af5e1ba0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65442024-12-18T22:21:18.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35510bf6-4a88-40bd-a0e1-2012b17a9ea5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65452024-12-18T22:21:18.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35510bf6-4a88-40bd-a0e1-2012b17a9ea5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65462024-12-18T22:21:18.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 35510bf6-4a88-40bd-a0e1-2012b17a9ea5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65472024-12-18T22:21:19.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02065d1-4a73-4592-bffd-3e0a87385b02 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65482024-12-18T22:21:19.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02065d1-4a73-4592-bffd-3e0a87385b02 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65492024-12-18T22:21:19.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02065d1-4a73-4592-bffd-3e0a87385b02 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65502024-12-18T22:21:20.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f3069fc-da9b-4b6e-b72b-75b18f9d3b22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65512024-12-18T22:21:20.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f3069fc-da9b-4b6e-b72b-75b18f9d3b22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65522024-12-18T22:21:20.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f3069fc-da9b-4b6e-b72b-75b18f9d3b22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65532024-12-18T22:21:21.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b35eaa5-0307-4320-852f-bdc1c7cb9f49 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65542024-12-18T22:21:21.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b35eaa5-0307-4320-852f-bdc1c7cb9f49 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65552024-12-18T22:21:21.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4b35eaa5-0307-4320-852f-bdc1c7cb9f49 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65562024-12-18T22:21:22.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d68cf4-3572-4472-bb47-034bd91e3998 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65572024-12-18T22:21:22.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d68cf4-3572-4472-bb47-034bd91e3998 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65582024-12-18T22:21:22.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 96d68cf4-3572-4472-bb47-034bd91e3998 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65592024-12-18T22:21:23.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
65602024-12-18T22:21:23.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
65612024-12-18T22:21:23.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65622024-12-18T22:21:23.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65632024-12-18T22:21:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65642024-12-18T22:21:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65652024-12-18T22:21:23.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65662024-12-18T22:21:23.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672024-12-18T22:21:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65682024-12-18T22:21:23.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.133211ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65692024-12-18T22:21:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65702024-12-18T22:21:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65712024-12-18T22:21:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65722024-12-18T22:21:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65732024-12-18T22:21:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65742024-12-18T22:21:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65752024-12-18T22:21:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
65762024-12-18T22:21:23.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65772024-12-18T22:21:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65782024-12-18T22:21:23.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
65792024-12-18T22:21:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.618574ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
65802024-12-18T22:21:23.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa21314e-17ae-45ee-85c4-97f45f48448a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65812024-12-18T22:21:23.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa21314e-17ae-45ee-85c4-97f45f48448a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65822024-12-18T22:21:23.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa21314e-17ae-45ee-85c4-97f45f48448a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65832024-12-18T22:21:24.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bfaf025-f1e1-4443-924c-8494f38ab384 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65842024-12-18T22:21:24.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bfaf025-f1e1-4443-924c-8494f38ab384 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65852024-12-18T22:21:24.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9bfaf025-f1e1-4443-924c-8494f38ab384 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65862024-12-18T22:21:26.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d9ebbb-b047-4ea0-82f9-aeaccf7745b4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65872024-12-18T22:21:26.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d9ebbb-b047-4ea0-82f9-aeaccf7745b4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65882024-12-18T22:21:26.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d9ebbb-b047-4ea0-82f9-aeaccf7745b4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65892024-12-18T22:21:26.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = ed01ef07-56c4-4819-98d0-0099ff24ccbf response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
65902024-12-18T22:21:27.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1637123c-9f23-4834-9fd6-33cd46b96ddc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65912024-12-18T22:21:27.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1637123c-9f23-4834-9fd6-33cd46b96ddc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65922024-12-18T22:21:27.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1637123c-9f23-4834-9fd6-33cd46b96ddc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65932024-12-18T22:21:28.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 292e4255-5661-4800-951a-f20aed490934 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65942024-12-18T22:21:28.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 292e4255-5661-4800-951a-f20aed490934 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65952024-12-18T22:21:28.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 292e4255-5661-4800-951a-f20aed490934 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65962024-12-18T22:21:29.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c565ba77-f6b9-4e37-8eb2-5132d262cce0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65972024-12-18T22:21:29.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c565ba77-f6b9-4e37-8eb2-5132d262cce0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65982024-12-18T22:21:29.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c565ba77-f6b9-4e37-8eb2-5132d262cce0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
65992024-12-18T22:21:30.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc832a7f-abda-427f-a45f-973825e28bfd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66002024-12-18T22:21:30.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc832a7f-abda-427f-a45f-973825e28bfd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66012024-12-18T22:21:30.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dc832a7f-abda-427f-a45f-973825e28bfd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66022024-12-18T22:21:31.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 372ccb10-677c-4219-9709-68b41fa1b90c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66032024-12-18T22:21:31.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 372ccb10-677c-4219-9709-68b41fa1b90c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66042024-12-18T22:21:31.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 372ccb10-677c-4219-9709-68b41fa1b90c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66052024-12-18T22:21:32.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ca77258-a6a7-4b3e-bfa8-8a0ceba4f637 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66062024-12-18T22:21:32.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ca77258-a6a7-4b3e-bfa8-8a0ceba4f637 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66072024-12-18T22:21:32.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ca77258-a6a7-4b3e-bfa8-8a0ceba4f637 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66082024-12-18T22:21:33.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9872e50-d254-44d7-85da-a5bddd0e7ce3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66092024-12-18T22:21:33.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9872e50-d254-44d7-85da-a5bddd0e7ce3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66102024-12-18T22:21:33.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9872e50-d254-44d7-85da-a5bddd0e7ce3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66112024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
66122024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66132024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
66142024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66152024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66162024-12-18T22:21:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66172024-12-18T22:21:33.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66182024-12-18T22:21:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66192024-12-18T22:21:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66202024-12-18T22:21:33.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.241823ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66212024-12-18T22:21:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66222024-12-18T22:21:33.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66232024-12-18T22:21:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66242024-12-18T22:21:33.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66252024-12-18T22:21:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66262024-12-18T22:21:33.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66272024-12-18T22:21:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
66282024-12-18T22:21:33.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66292024-12-18T22:21:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66302024-12-18T22:21:33.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
66312024-12-18T22:21:33.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.481022ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
66322024-12-18T22:21:34.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e52b57d7-1195-44ad-af91-486fc26f3e1b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66332024-12-18T22:21:34.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e52b57d7-1195-44ad-af91-486fc26f3e1b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66342024-12-18T22:21:34.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e52b57d7-1195-44ad-af91-486fc26f3e1b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66352024-12-18T22:21:35.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = efc0d565-6f3f-45c6-8cc4-c76a769394b0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66362024-12-18T22:21:35.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = efc0d565-6f3f-45c6-8cc4-c76a769394b0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66372024-12-18T22:21:35.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = efc0d565-6f3f-45c6-8cc4-c76a769394b0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66382024-12-18T22:21:36.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1a3b48-863b-4ef8-a38e-591f8592c847 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66392024-12-18T22:21:36.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1a3b48-863b-4ef8-a38e-591f8592c847 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66402024-12-18T22:21:36.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf1a3b48-863b-4ef8-a38e-591f8592c847 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66412024-12-18T22:21:36.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 2d29ce02-fd44-4365-93a2-1a339f17cfc3 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
66422024-12-18T22:21:37.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4bf6d797-634e-41ec-8fe7-33ac3c270f64 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66432024-12-18T22:21:37.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4bf6d797-634e-41ec-8fe7-33ac3c270f64 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66442024-12-18T22:21:37.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4bf6d797-634e-41ec-8fe7-33ac3c270f64 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66452024-12-18T22:21:38.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3a2e214-0306-4803-ba99-58a6fd7f34e8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66462024-12-18T22:21:38.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3a2e214-0306-4803-ba99-58a6fd7f34e8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66472024-12-18T22:21:38.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3a2e214-0306-4803-ba99-58a6fd7f34e8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66482024-12-18T22:21:39.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 957b557e-b7d1-42fe-9191-5e13e2a08f9d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66492024-12-18T22:21:39.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 957b557e-b7d1-42fe-9191-5e13e2a08f9d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66502024-12-18T22:21:39.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 957b557e-b7d1-42fe-9191-5e13e2a08f9d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66512024-12-18T22:21:40.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79282065-f611-4b96-867c-679d741fc60f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66522024-12-18T22:21:40.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79282065-f611-4b96-867c-679d741fc60f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66532024-12-18T22:21:40.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79282065-f611-4b96-867c-679d741fc60f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66542024-12-18T22:21:41.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88835742-2241-4ebf-a553-7f3bffe738cf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66552024-12-18T22:21:41.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88835742-2241-4ebf-a553-7f3bffe738cf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66562024-12-18T22:21:41.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88835742-2241-4ebf-a553-7f3bffe738cf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66572024-12-18T22:21:42.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7f9a7b7d-e58b-450a-9419-6d5ff4239444 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66582024-12-18T22:21:42.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7f9a7b7d-e58b-450a-9419-6d5ff4239444 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66592024-12-18T22:21:42.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7f9a7b7d-e58b-450a-9419-6d5ff4239444 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66602024-12-18T22:21:43.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 53370fae-4ca3-4539-9a85-e707c376e28d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66612024-12-18T22:21:43.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 53370fae-4ca3-4539-9a85-e707c376e28d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66622024-12-18T22:21:43.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 53370fae-4ca3-4539-9a85-e707c376e28d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
66632024-12-18T22:21:43.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 34d37f01-7c96-4325-9a1e-781727c0e034 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66642024-12-18T22:21:43.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 34d37f01-7c96-4325-9a1e-781727c0e034 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66652024-12-18T22:21:43.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 34d37f01-7c96-4325-9a1e-781727c0e034 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66662024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
66672024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66682024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
66692024-12-18T22:21:43.795ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66702024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
66712024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66722024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66732024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
66742024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
66752024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66762024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66772024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
66782024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
66792024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
66802024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66812024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66822024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
66832024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
66842024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66852024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66862024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
66872024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
66882024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66892024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66902024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
66912024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66922024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
66932024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66942024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
66952024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66962024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66972024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
66982024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66992024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
67002024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67012024-12-18T22:21:43.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67022024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67032024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67042024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67052024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67062024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67072024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67082024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67092024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67102024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67112024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67122024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67132024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67142024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67152024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67162024-12-18T22:21:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67172024-12-18T22:21:43.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-12-18T22:21:43.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67192024-12-18T22:21:43.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.487548ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67202024-12-18T22:21:43.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67212024-12-18T22:21:43.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 419300316 } })
67222024-12-18T22:21:43.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67232024-12-18T22:21:43.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67242024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67252024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67262024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67272024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67282024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67292024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67302024-12-18T22:21:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67312024-12-18T22:21:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67322024-12-18T22:21:43.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67332024-12-18T22:21:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67342024-12-18T22:21:43.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.17931ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
67352024-12-18T22:21:43.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 423431287 } })
67362024-12-18T22:21:43.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67372024-12-18T22:21:43.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.392334ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
67382024-12-18T22:21:43.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67392024-12-18T22:21:43.805ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67402024-12-18T22:21:43.805ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67412024-12-18T22:21:43.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67422024-12-18T22:21:43.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67432024-12-18T22:21:43.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67442024-12-18T22:21:43.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67452024-12-18T22:21:43.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.004816ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67462024-12-18T22:21:43.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67472024-12-18T22:21:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67482024-12-18T22:21:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67492024-12-18T22:21:43.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67502024-12-18T22:21:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67512024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67522024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67532024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67542024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67552024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67562024-12-18T22:21:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67572024-12-18T22:21:43.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67582024-12-18T22:21:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67592024-12-18T22:21:43.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67602024-12-18T22:21:43.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67612024-12-18T22:21:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67622024-12-18T22:21:43.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67632024-12-18T22:21:43.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67642024-12-18T22:21:43.811ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67652024-12-18T22:21:43.811ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67662024-12-18T22:21:43.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67672024-12-18T22:21:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67682024-12-18T22:21:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67692024-12-18T22:21:43.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67702024-12-18T22:21:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67712024-12-18T22:21:43.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67722024-12-18T22:21:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67732024-12-18T22:21:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67742024-12-18T22:21:43.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 434349502 } })
67752024-12-18T22:21:43.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
67762024-12-18T22:21:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67772024-12-18T22:21:43.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67782024-12-18T22:21:43.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-12-18T22:21:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67802024-12-18T22:21:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
67812024-12-18T22:21:43.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67822024-12-18T22:21:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67832024-12-18T22:21:43.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
67842024-12-18T22:21:43.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.607096ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
67852024-12-18T22:21:43.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67862024-12-18T22:21:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67872024-12-18T22:21:43.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67882024-12-18T22:21:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67892024-12-18T22:21:43.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67902024-12-18T22:21:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67912024-12-18T22:21:43.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67922024-12-18T22:21:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.926936ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67932024-12-18T22:21:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67942024-12-18T22:21:43.853ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67952024-12-18T22:21:43.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.349815ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67962024-12-18T22:21:43.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67972024-12-18T22:21:43.855ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67982024-12-18T22:21:43.855ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67992024-12-18T22:21:43.855ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.291773ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68002024-12-18T22:21:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
68012024-12-18T22:21:43.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68022024-12-18T22:21:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68032024-12-18T22:21:43.858ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.971095ms iteration = 16 status = 0
68042024-12-18T22:21:43.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68052024-12-18T22:21:43.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68062024-12-18T22:21:43.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-12-18T22:21:43.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68082024-12-18T22:21:43.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68092024-12-18T22:21:43.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68102024-12-18T22:21:43.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68112024-12-18T22:21:43.870ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68122024-12-18T22:21:43.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132024-12-18T22:21:43.871ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f42897f-22ea-470a-a290-be2452039e72", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68142024-12-18T22:21:43.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68152024-12-18T22:21:43.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68162024-12-18T22:21:43.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68172024-12-18T22:21:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68182024-12-18T22:21:43.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68192024-12-18T22:21:43.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68202024-12-18T22:21:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68212024-12-18T22:21:43.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.531298ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68222024-12-18T22:21:43.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.268111ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68232024-12-18T22:21:43.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68242024-12-18T22:21:43.905ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68252024-12-18T22:21:43.905ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1c836ed-2c86-4920-af82-de2e96b0fbd4", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68262024-12-18T22:21:43.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68272024-12-18T22:21:43.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68282024-12-18T22:21:43.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
68292024-12-18T22:21:43.909ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68302024-12-18T22:21:43.909ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f40959ec-2812-4d38-8004-6828e2a7bca7", "content-length": "26", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68312024-12-18T22:21:43.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68322024-12-18T22:21:43.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
68332024-12-18T22:21:43.921ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.496102ms iteration = 18 status = {"physical_disks_added":0}
68342024-12-18T22:21:44.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68352024-12-18T22:21:44.030ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b83462-16ad-470e-97a6-275b633a26d8", "content-length": "691", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68362024-12-18T22:21:44.030ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68372024-12-18T22:21:44.030ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68382024-12-18T22:21:44.030ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68392024-12-18T22:21:44.031ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.729874ms iteration = 16 status = {}
68402024-12-18T22:21:44.058ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 263.168494ms iteration = 16 status = {}
68412024-12-18T22:21:44.123ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68422024-12-18T22:21:44.123ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "25d1eccf-e567-45b5-957a-1d6b7267650b", "content-length": "1", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68432024-12-18T22:21:44.124ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68442024-12-18T22:21:44.124ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68452024-12-18T22:21:44.124ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ae209e-6974-4628-9566-791f8d049a72", "content-length": "372", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68462024-12-18T22:21:44.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68472024-12-18T22:21:44.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68482024-12-18T22:21:44.125ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68492024-12-18T22:21:44.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68502024-12-18T22:21:44.128ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 332.555635ms iteration = 16 status = null
68512024-12-18T22:21:44.137ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68522024-12-18T22:21:44.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68532024-12-18T22:21:44.138ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "85efe175-0e1d-48ee-9846-66bbee1a2137", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68542024-12-18T22:21:44.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68552024-12-18T22:21:44.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68562024-12-18T22:21:44.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68572024-12-18T22:21:44.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68582024-12-18T22:21:44.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68592024-12-18T22:21:44.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68602024-12-18T22:21:44.147ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68612024-12-18T22:21:44.147ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68622024-12-18T22:21:44.147ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a7df603-85ca-47d7-aacb-aa275ef19e90", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68632024-12-18T22:21:44.149ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 354.335423ms iteration = 16 status = {}
68642024-12-18T22:21:44.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68652024-12-18T22:21:44.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68662024-12-18T22:21:44.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
68672024-12-18T22:21:44.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68682024-12-18T22:21:44.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68692024-12-18T22:21:44.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68702024-12-18T22:21:44.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd66c0bc-0844-4af5-9cd4-11cdba13d38f", "content-length": "134", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68712024-12-18T22:21:44.171ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68722024-12-18T22:21:44.171ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
68732024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68742024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68752024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68762024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68772024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68782024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68792024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68802024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68812024-12-18T22:21:44.172ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
68822024-12-18T22:21:44.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68832024-12-18T22:21:44.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68842024-12-18T22:21:44.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68852024-12-18T22:21:44.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "78efc5b9-b24d-4513-8af3-66eb87d2f85a", "content-length": "2", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68862024-12-18T22:21:44.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68872024-12-18T22:21:44.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a40dbfe5-881c-4ab0-a134-8e5b65af94d4", "content-length": "52", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68882024-12-18T22:21:44.174ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
68892024-12-18T22:21:44.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68902024-12-18T22:21:44.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b8743587-d981-40fb-96c0-78e280b0004f", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68912024-12-18T22:21:44.269ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
68922024-12-18T22:21:44.269ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68932024-12-18T22:21:44.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c25fa2-b8fb-4d7a-bc5c-7d63de9eec28", "content-length": "682", "date": "Wed, 18 Dec 2024 22:21:43 GMT"} })
68942024-12-18T22:21:44.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68952024-12-18T22:21:44.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68962024-12-18T22:21:44.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68972024-12-18T22:21:44.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68982024-12-18T22:21:44.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68992024-12-18T22:21:44.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69002024-12-18T22:21:44.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69012024-12-18T22:21:44.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69022024-12-18T22:21:44.284ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 488.980004ms iteration = 16 status = {}
69032024-12-18T22:21:44.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f05bdeb-c20d-449a-bfb8-6027aea1bd2a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69042024-12-18T22:21:44.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f05bdeb-c20d-449a-bfb8-6027aea1bd2a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69052024-12-18T22:21:44.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f05bdeb-c20d-449a-bfb8-6027aea1bd2a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69062024-12-18T22:21:45.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454bb117-574b-4208-b9ba-642cb90c20b6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69072024-12-18T22:21:45.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454bb117-574b-4208-b9ba-642cb90c20b6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69082024-12-18T22:21:45.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454bb117-574b-4208-b9ba-642cb90c20b6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69092024-12-18T22:21:46.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3aea9f0-7dd1-4200-a661-af0c26b73fe0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69102024-12-18T22:21:46.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3aea9f0-7dd1-4200-a661-af0c26b73fe0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69112024-12-18T22:21:46.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3aea9f0-7dd1-4200-a661-af0c26b73fe0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69122024-12-18T22:21:46.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 545 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 23fa32b0-05f5-4b9d-9d50-13b7ecb63843 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
69132024-12-18T22:21:47.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16805917-d6d8-4089-8150-ee8c10b2b7d9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69142024-12-18T22:21:47.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16805917-d6d8-4089-8150-ee8c10b2b7d9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69152024-12-18T22:21:47.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 16805917-d6d8-4089-8150-ee8c10b2b7d9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69162024-12-18T22:21:48.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcb9cdf0-a3a5-4697-93c0-1eaa9b2020fd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69172024-12-18T22:21:48.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcb9cdf0-a3a5-4697-93c0-1eaa9b2020fd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69182024-12-18T22:21:48.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcb9cdf0-a3a5-4697-93c0-1eaa9b2020fd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69192024-12-18T22:21:49.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99d8998d-663e-4c14-abbd-8df0917972fd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69202024-12-18T22:21:49.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99d8998d-663e-4c14-abbd-8df0917972fd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69212024-12-18T22:21:49.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 99d8998d-663e-4c14-abbd-8df0917972fd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69222024-12-18T22:21:50.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9a71211-549f-4aa0-bf6a-e24cbc2c5eb2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69232024-12-18T22:21:50.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9a71211-549f-4aa0-bf6a-e24cbc2c5eb2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69242024-12-18T22:21:50.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9a71211-549f-4aa0-bf6a-e24cbc2c5eb2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69252024-12-18T22:21:51.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f2b662c7-543b-4a04-87c8-884f0a974f66 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69262024-12-18T22:21:51.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f2b662c7-543b-4a04-87c8-884f0a974f66 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69272024-12-18T22:21:51.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f2b662c7-543b-4a04-87c8-884f0a974f66 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69282024-12-18T22:21:52.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff880a6f-4dab-42b8-b15a-e5569911852d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69292024-12-18T22:21:52.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff880a6f-4dab-42b8-b15a-e5569911852d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69302024-12-18T22:21:52.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ff880a6f-4dab-42b8-b15a-e5569911852d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69312024-12-18T22:21:53.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8be4e52f-9ed6-459b-ae41-1cc4ee859803 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69322024-12-18T22:21:53.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8be4e52f-9ed6-459b-ae41-1cc4ee859803 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69332024-12-18T22:21:53.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8be4e52f-9ed6-459b-ae41-1cc4ee859803 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69342024-12-18T22:21:53.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
69352024-12-18T22:21:53.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69362024-12-18T22:21:53.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
69372024-12-18T22:21:53.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69382024-12-18T22:21:53.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69392024-12-18T22:21:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69402024-12-18T22:21:53.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69412024-12-18T22:21:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69422024-12-18T22:21:53.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69432024-12-18T22:21:53.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.787064ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69442024-12-18T22:21:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69452024-12-18T22:21:53.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69462024-12-18T22:21:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69472024-12-18T22:21:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69482024-12-18T22:21:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69492024-12-18T22:21:53.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69502024-12-18T22:21:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
69512024-12-18T22:21:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522024-12-18T22:21:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532024-12-18T22:21:53.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
69542024-12-18T22:21:53.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.547773ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
69552024-12-18T22:21:54.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c314d49f-077a-4106-bd3f-87f346062e16 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69562024-12-18T22:21:54.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c314d49f-077a-4106-bd3f-87f346062e16 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69572024-12-18T22:21:54.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c314d49f-077a-4106-bd3f-87f346062e16 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69582024-12-18T22:21:55.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2259d5c5-8d7c-4ecc-8eeb-c27f2867eb7e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69592024-12-18T22:21:55.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2259d5c5-8d7c-4ecc-8eeb-c27f2867eb7e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69602024-12-18T22:21:55.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2259d5c5-8d7c-4ecc-8eeb-c27f2867eb7e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69612024-12-18T22:21:56.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 9d2cd06d-3dea-40a4-8e67-289e36ac49e3 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
69622024-12-18T22:21:56.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8e79bd-614d-4f9e-93ae-f8c11e606a9f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69632024-12-18T22:21:56.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8e79bd-614d-4f9e-93ae-f8c11e606a9f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69642024-12-18T22:21:56.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ba8e79bd-614d-4f9e-93ae-f8c11e606a9f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69652024-12-18T22:21:57.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 003f2346-c65a-49c8-8cd4-0d9b475e624b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69662024-12-18T22:21:57.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 003f2346-c65a-49c8-8cd4-0d9b475e624b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69672024-12-18T22:21:57.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 003f2346-c65a-49c8-8cd4-0d9b475e624b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69682024-12-18T22:21:58.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 914c4048-9d6f-4a69-b846-6cadeb2d3e9d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69692024-12-18T22:21:58.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 914c4048-9d6f-4a69-b846-6cadeb2d3e9d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69702024-12-18T22:21:58.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 914c4048-9d6f-4a69-b846-6cadeb2d3e9d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69712024-12-18T22:21:59.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45b51869-bf1d-41af-a19f-794f9e0a569e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69722024-12-18T22:21:59.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45b51869-bf1d-41af-a19f-794f9e0a569e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69732024-12-18T22:21:59.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45b51869-bf1d-41af-a19f-794f9e0a569e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69742024-12-18T22:22:00.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3345ce5-93b3-486b-90dc-cd7b73076da8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69752024-12-18T22:22:00.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3345ce5-93b3-486b-90dc-cd7b73076da8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69762024-12-18T22:22:00.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3345ce5-93b3-486b-90dc-cd7b73076da8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69772024-12-18T22:22:01.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1532d399-0971-45ba-965e-60b02d9861bc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69782024-12-18T22:22:01.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1532d399-0971-45ba-965e-60b02d9861bc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69792024-12-18T22:22:01.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1532d399-0971-45ba-965e-60b02d9861bc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69802024-12-18T22:22:02.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33dc7378-844e-40fc-ba38-30eac9bd1742 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69812024-12-18T22:22:02.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33dc7378-844e-40fc-ba38-30eac9bd1742 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69822024-12-18T22:22:02.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33dc7378-844e-40fc-ba38-30eac9bd1742 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
69832024-12-18T22:22:03.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
69842024-12-18T22:22:03.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
69852024-12-18T22:22:03.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69862024-12-18T22:22:03.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69872024-12-18T22:22:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69882024-12-18T22:22:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69892024-12-18T22:22:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69902024-12-18T22:22:03.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69912024-12-18T22:22:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69922024-12-18T22:22:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69932024-12-18T22:22:03.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69942024-12-18T22:22:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69952024-12-18T22:22:03.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.661931ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69962024-12-18T22:22:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69972024-12-18T22:22:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69982024-12-18T22:22:03.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69992024-12-18T22:22:03.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
70002024-12-18T22:22:03.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70012024-12-18T22:22:03.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70022024-12-18T22:22:03.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
70032024-12-18T22:22:03.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.729777ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
70042024-12-18T22:22:03.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ecd609e-58d7-4c9b-bc30-7507c1947f83 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70052024-12-18T22:22:03.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ecd609e-58d7-4c9b-bc30-7507c1947f83 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70062024-12-18T22:22:03.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8ecd609e-58d7-4c9b-bc30-7507c1947f83 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70072024-12-18T22:22:04.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6636c1f3-7239-47e3-b671-20ddae4f3f8e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70082024-12-18T22:22:04.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6636c1f3-7239-47e3-b671-20ddae4f3f8e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70092024-12-18T22:22:04.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6636c1f3-7239-47e3-b671-20ddae4f3f8e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70102024-12-18T22:22:05.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 804047e8-7229-4ef9-9c6f-89fda3a2f936 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70112024-12-18T22:22:05.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 804047e8-7229-4ef9-9c6f-89fda3a2f936 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70122024-12-18T22:22:05.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 804047e8-7229-4ef9-9c6f-89fda3a2f936 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70132024-12-18T22:22:06.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 340ccd20-fb8c-48f1-b063-bcfbab486e51 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
70142024-12-18T22:22:06.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 51342b12-4ed5-46b9-94a3-6e16dfc030ac roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70152024-12-18T22:22:06.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 51342b12-4ed5-46b9-94a3-6e16dfc030ac resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70162024-12-18T22:22:06.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 51342b12-4ed5-46b9-94a3-6e16dfc030ac response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70172024-12-18T22:22:07.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39915ca9-88d2-4a02-b03c-7d5b49868b23 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70182024-12-18T22:22:07.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39915ca9-88d2-4a02-b03c-7d5b49868b23 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70192024-12-18T22:22:07.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39915ca9-88d2-4a02-b03c-7d5b49868b23 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70202024-12-18T22:22:08.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1e0851-acd0-473e-b6bd-7319a2a26c6f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70212024-12-18T22:22:08.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1e0851-acd0-473e-b6bd-7319a2a26c6f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70222024-12-18T22:22:08.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f1e0851-acd0-473e-b6bd-7319a2a26c6f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70232024-12-18T22:22:09.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 352e05d1-bb8d-4b6c-a316-5936fd8e3f4f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70242024-12-18T22:22:09.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 352e05d1-bb8d-4b6c-a316-5936fd8e3f4f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70252024-12-18T22:22:09.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 352e05d1-bb8d-4b6c-a316-5936fd8e3f4f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70262024-12-18T22:22:10.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6dc895a1-0c7c-4cbc-8675-c18bdcd98520 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70272024-12-18T22:22:10.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6dc895a1-0c7c-4cbc-8675-c18bdcd98520 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70282024-12-18T22:22:10.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6dc895a1-0c7c-4cbc-8675-c18bdcd98520 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70292024-12-18T22:22:12.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b61c331-9a3a-4c92-91e3-315c00603ea1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70302024-12-18T22:22:12.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b61c331-9a3a-4c92-91e3-315c00603ea1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70312024-12-18T22:22:12.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b61c331-9a3a-4c92-91e3-315c00603ea1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70322024-12-18T22:22:13.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e853ef6d-23cf-4fef-93f9-b02bc19acbbb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70332024-12-18T22:22:13.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e853ef6d-23cf-4fef-93f9-b02bc19acbbb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70342024-12-18T22:22:13.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e853ef6d-23cf-4fef-93f9-b02bc19acbbb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
70352024-12-18T22:22:13.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1c7c8135-86ec-41b5-bbe0-5af90fcf54e7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70362024-12-18T22:22:13.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1c7c8135-86ec-41b5-bbe0-5af90fcf54e7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70372024-12-18T22:22:13.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 1c7c8135-86ec-41b5-bbe0-5af90fcf54e7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70382024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
70392024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70402024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
70412024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
70422024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70432024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70442024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
70452024-12-18T22:22:13.795ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70462024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
70472024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70482024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70492024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
70502024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
70512024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70522024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70532024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
70542024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
70552024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
70562024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70572024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
70582024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
70592024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70602024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
70612024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
70632024-12-18T22:22:13.795ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
70642024-12-18T22:22:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70652024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.371\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
70662024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
70672024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
70682024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70692024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
70702024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70712024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70722024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
70732024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70742024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
70752024-12-18T22:22:13.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70762024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
70772024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70782024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70792024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
70802024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
70812024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70822024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
70832024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70842024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
70852024-12-18T22:22:13.796ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:12:13.796067864 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70862024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70872024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
70882024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70892024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
70902024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70912024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
70922024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
70932024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70942024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70952024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
70962024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70972024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70982024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
70992024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71002024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71012024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71022024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71032024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71042024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71052024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71062024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71072024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71082024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71092024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71102024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71112024-12-18T22:22:13.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 416159765 } })
71122024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71132024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71142024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71152024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71162024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71172024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71182024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71192024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71202024-12-18T22:22:13.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 416281277 } })
71212024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71222024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71232024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71242024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71252024-12-18T22:22:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71262024-12-18T22:22:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
71272024-12-18T22:22:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.365216ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
71282024-12-18T22:22:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
71292024-12-18T22:22:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.189004ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
71302024-12-18T22:22:13.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71312024-12-18T22:22:13.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71322024-12-18T22:22:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.56868ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71332024-12-18T22:22:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71342024-12-18T22:22:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.833966ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
71352024-12-18T22:22:13.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71362024-12-18T22:22:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71372024-12-18T22:22:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71382024-12-18T22:22:13.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71392024-12-18T22:22:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71402024-12-18T22:22:13.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412024-12-18T22:22:13.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 422509479 } })
71422024-12-18T22:22:13.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71432024-12-18T22:22:13.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71442024-12-18T22:22:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71452024-12-18T22:22:13.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71462024-12-18T22:22:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71472024-12-18T22:22:13.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482024-12-18T22:22:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71492024-12-18T22:22:13.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71502024-12-18T22:22:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71512024-12-18T22:22:13.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522024-12-18T22:22:13.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532024-12-18T22:22:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71542024-12-18T22:22:13.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71552024-12-18T22:22:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71562024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71572024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71582024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71592024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71602024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71612024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71622024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632024-12-18T22:22:13.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71642024-12-18T22:22:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71652024-12-18T22:22:13.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662024-12-18T22:22:13.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71672024-12-18T22:22:13.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71682024-12-18T22:22:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71692024-12-18T22:22:13.811ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:12:13.796067864 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71702024-12-18T22:22:13.811ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.184728ms iteration = 9 status = {"expiration":"2024-12-18T22:12:13.796067864Z","pruned":[]}
71712024-12-18T22:22:13.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 431484325 } })
71722024-12-18T22:22:13.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71732024-12-18T22:22:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71742024-12-18T22:22:13.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71752024-12-18T22:22:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71762024-12-18T22:22:13.812ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.441313ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
71772024-12-18T22:22:13.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71782024-12-18T22:22:13.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71792024-12-18T22:22:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71802024-12-18T22:22:13.815ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71812024-12-18T22:22:13.815ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71822024-12-18T22:22:13.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71832024-12-18T22:22:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71842024-12-18T22:22:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71852024-12-18T22:22:13.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71862024-12-18T22:22:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71872024-12-18T22:22:13.817ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71882024-12-18T22:22:13.817ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71892024-12-18T22:22:13.817ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.88932ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71902024-12-18T22:22:13.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71912024-12-18T22:22:13.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922024-12-18T22:22:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71932024-12-18T22:22:13.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71942024-12-18T22:22:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71952024-12-18T22:22:13.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71962024-12-18T22:22:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71972024-12-18T22:22:13.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 442716446 } })
71982024-12-18T22:22:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71992024-12-18T22:22:13.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
72002024-12-18T22:22:13.824ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
72012024-12-18T22:22:13.824ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
72022024-12-18T22:22:13.824ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
72032024-12-18T22:22:13.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72042024-12-18T22:22:13.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72052024-12-18T22:22:13.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72062024-12-18T22:22:13.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72072024-12-18T22:22:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72082024-12-18T22:22:13.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72092024-12-18T22:22:13.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72102024-12-18T22:22:13.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72112024-12-18T22:22:13.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122024-12-18T22:22:13.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72132024-12-18T22:22:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72142024-12-18T22:22:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72152024-12-18T22:22:13.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72162024-12-18T22:22:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72172024-12-18T22:22:13.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182024-12-18T22:22:13.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72192024-12-18T22:22:13.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72202024-12-18T22:22:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72212024-12-18T22:22:13.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.578732ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
72222024-12-18T22:22:13.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72232024-12-18T22:22:13.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72242024-12-18T22:22:13.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72252024-12-18T22:22:13.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72262024-12-18T22:22:13.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72272024-12-18T22:22:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72282024-12-18T22:22:13.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.958547ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72292024-12-18T22:22:13.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72302024-12-18T22:22:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72312024-12-18T22:22:13.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.131768ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72322024-12-18T22:22:13.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72332024-12-18T22:22:13.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72342024-12-18T22:22:13.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.435371ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72352024-12-18T22:22:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72362024-12-18T22:22:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
72372024-12-18T22:22:13.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72382024-12-18T22:22:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72392024-12-18T22:22:13.870ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72402024-12-18T22:22:13.870ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72412024-12-18T22:22:13.870ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.219576ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72422024-12-18T22:22:13.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72432024-12-18T22:22:13.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72442024-12-18T22:22:13.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452024-12-18T22:22:13.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72462024-12-18T22:22:13.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72472024-12-18T22:22:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72482024-12-18T22:22:13.877ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72492024-12-18T22:22:13.877ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72502024-12-18T22:22:13.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72512024-12-18T22:22:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72522024-12-18T22:22:13.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72532024-12-18T22:22:13.880ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72542024-12-18T22:22:13.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.149271ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72552024-12-18T22:22:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72562024-12-18T22:22:13.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72572024-12-18T22:22:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72582024-12-18T22:22:13.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
72592024-12-18T22:22:13.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.084915ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
72602024-12-18T22:22:13.899ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
72612024-12-18T22:22:13.899ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 103.48222ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72622024-12-18T22:22:13.899ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72632024-12-18T22:22:13.899ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72642024-12-18T22:22:13.900ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72652024-12-18T22:22:13.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72662024-12-18T22:22:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72672024-12-18T22:22:13.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72682024-12-18T22:22:13.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72692024-12-18T22:22:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
72702024-12-18T22:22:13.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72712024-12-18T22:22:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-12-18T22:22:13.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.613051ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72732024-12-18T22:22:13.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72742024-12-18T22:22:13.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72752024-12-18T22:22:13.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72762024-12-18T22:22:13.908ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.66437ms iteration = 17 status = 0
72772024-12-18T22:22:13.916ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72782024-12-18T22:22:13.916ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72792024-12-18T22:22:13.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72802024-12-18T22:22:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72812024-12-18T22:22:13.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72822024-12-18T22:22:13.919ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72832024-12-18T22:22:13.919ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72842024-12-18T22:22:13.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.655487ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72852024-12-18T22:22:13.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72862024-12-18T22:22:13.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72872024-12-18T22:22:13.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72882024-12-18T22:22:13.923ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72892024-12-18T22:22:13.923ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72902024-12-18T22:22:13.923ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
72912024-12-18T22:22:13.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 127.604194ms iteration = 9 status = {"generation":1}
72922024-12-18T22:22:13.929ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72932024-12-18T22:22:13.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 133.722543ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72942024-12-18T22:22:13.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72952024-12-18T22:22:13.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72962024-12-18T22:22:13.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72972024-12-18T22:22:13.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
72982024-12-18T22:22:13.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72992024-12-18T22:22:13.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73002024-12-18T22:22:13.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-12-18T22:22:13.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73022024-12-18T22:22:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73032024-12-18T22:22:13.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73042024-12-18T22:22:13.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73052024-12-18T22:22:13.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
73062024-12-18T22:22:13.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73072024-12-18T22:22:13.946ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
73082024-12-18T22:22:13.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 150.269388ms iteration = 9 status = {"generation":2}
73092024-12-18T22:22:13.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
73102024-12-18T22:22:13.963ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.784712ms iteration = 19 status = {"physical_disks_added":0}
73112024-12-18T22:22:13.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73122024-12-18T22:22:13.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73132024-12-18T22:22:13.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73142024-12-18T22:22:13.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73152024-12-18T22:22:13.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73162024-12-18T22:22:13.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73172024-12-18T22:22:13.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73182024-12-18T22:22:13.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73192024-12-18T22:22:13.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
73202024-12-18T22:22:13.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73212024-12-18T22:22:13.985ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a575d2-3d4f-475a-8c93-6436a031e582", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73222024-12-18T22:22:13.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73232024-12-18T22:22:13.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
73242024-12-18T22:22:14.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0c0f5e-d5ec-4c2e-b333-c4fb54494f27 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
73252024-12-18T22:22:14.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0c0f5e-d5ec-4c2e-b333-c4fb54494f27 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
73262024-12-18T22:22:14.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0c0f5e-d5ec-4c2e-b333-c4fb54494f27 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
73272024-12-18T22:22:14.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73282024-12-18T22:22:14.109ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73292024-12-18T22:22:14.109ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5538f485-a0c4-482d-94db-7b69b69d2cb5", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73302024-12-18T22:22:14.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73312024-12-18T22:22:14.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73322024-12-18T22:22:14.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73332024-12-18T22:22:14.116ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73342024-12-18T22:22:14.116ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab8e0e0-b46e-4638-9c7c-abd989347c53", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73352024-12-18T22:22:14.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73362024-12-18T22:22:14.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73372024-12-18T22:22:14.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73382024-12-18T22:22:14.152ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5fb6b946-2071-43e8-88ed-d8660ae34583", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73392024-12-18T22:22:14.152ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73402024-12-18T22:22:14.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e10dd1c7-d56b-4d27-b1d6-d5de24c4ff91", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73412024-12-18T22:22:14.153ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73422024-12-18T22:22:14.155ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73432024-12-18T22:22:14.156ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 360.054184ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73442024-12-18T22:22:14.198ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73452024-12-18T22:22:14.198ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73462024-12-18T22:22:14.198ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e7b83f7-b913-4a37-8f7f-7a98abdb66e9", "content-length": "372", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73472024-12-18T22:22:14.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73482024-12-18T22:22:14.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73492024-12-18T22:22:14.225ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73502024-12-18T22:22:14.225ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "590b0a04-dd7e-4aba-b1dc-c0d639aed68d", "content-length": "691", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73512024-12-18T22:22:14.225ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73522024-12-18T22:22:14.225ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73532024-12-18T22:22:14.225ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73542024-12-18T22:22:14.227ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 431.320453ms iteration = 17 status = {}
73552024-12-18T22:22:14.238ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73562024-12-18T22:22:14.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73572024-12-18T22:22:14.239ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f9ac3aae-e1d5-459c-baaf-873b89453f76", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73582024-12-18T22:22:14.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73592024-12-18T22:22:14.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73602024-12-18T22:22:14.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73612024-12-18T22:22:14.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73622024-12-18T22:22:14.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73632024-12-18T22:22:14.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73642024-12-18T22:22:14.250ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73652024-12-18T22:22:14.250ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73662024-12-18T22:22:14.251ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6f7579c8-7d76-4844-9e85-55b0b380654a", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73672024-12-18T22:22:14.252ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 456.937465ms iteration = 17 status = {}
73682024-12-18T22:22:14.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73692024-12-18T22:22:14.290ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73702024-12-18T22:22:14.290ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "980c8472-2057-4b02-8680-fea4c2f8d265", "content-length": "1", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73712024-12-18T22:22:14.291ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73722024-12-18T22:22:14.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73732024-12-18T22:22:14.293ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 497.880959ms iteration = 17 status = null
73742024-12-18T22:22:14.462ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 666.466816ms iteration = 17 status = {}
73752024-12-18T22:22:14.512ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73762024-12-18T22:22:14.513ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "734f4d09-0bb3-48ce-ba08-f91934cca9e3", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73772024-12-18T22:22:14.513ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73782024-12-18T22:22:14.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "81c5adf7-e7e1-415f-9f99-ce17396149db", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73792024-12-18T22:22:14.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73802024-12-18T22:22:14.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a4c578a1-ca70-4719-b133-12b2933e6229", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73812024-12-18T22:22:14.516ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73822024-12-18T22:22:14.518ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
73832024-12-18T22:22:14.518ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 722.794971ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73842024-12-18T22:22:14.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73852024-12-18T22:22:14.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73862024-12-18T22:22:14.554ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
73872024-12-18T22:22:14.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73882024-12-18T22:22:14.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73892024-12-18T22:22:14.565ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73902024-12-18T22:22:14.565ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f1e91ec-cceb-4a18-ad79-80055668ec92", "content-length": "134", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
73912024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73922024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
73932024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73942024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73952024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73962024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73972024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73982024-12-18T22:22:14.565ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73992024-12-18T22:22:14.566ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74002024-12-18T22:22:14.566ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74012024-12-18T22:22:14.566ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
74022024-12-18T22:22:14.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74032024-12-18T22:22:14.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74042024-12-18T22:22:14.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74052024-12-18T22:22:14.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0af2e67-8152-4dcf-bc01-862f9a8d9fd0", "content-length": "2", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
74062024-12-18T22:22:14.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74072024-12-18T22:22:14.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "775c03cc-93b6-49d8-b3d5-5b606d17eaf2", "content-length": "52", "date": "Wed, 18 Dec 2024 22:22:13 GMT"} })
74082024-12-18T22:22:14.568ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
74092024-12-18T22:22:14.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74102024-12-18T22:22:14.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "689f2c5b-8052-4990-90f3-fddebff26e38", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} })
74112024-12-18T22:22:14.666ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
74122024-12-18T22:22:14.666ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74132024-12-18T22:22:14.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e532fe93-a241-4c43-ae4a-48fa4aa6c5f8", "content-length": "682", "date": "Wed, 18 Dec 2024 22:22:14 GMT"} })
74142024-12-18T22:22:14.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74152024-12-18T22:22:14.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74162024-12-18T22:22:14.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74172024-12-18T22:22:14.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74182024-12-18T22:22:14.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74192024-12-18T22:22:14.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74202024-12-18T22:22:14.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212024-12-18T22:22:14.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74222024-12-18T22:22:14.683ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 887.577274ms iteration = 17 status = {}
74232024-12-18T22:22:15.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20a15bb1-4457-4c37-83e2-0e986d1e4b9e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74242024-12-18T22:22:15.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20a15bb1-4457-4c37-83e2-0e986d1e4b9e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74252024-12-18T22:22:15.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20a15bb1-4457-4c37-83e2-0e986d1e4b9e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74262024-12-18T22:22:16.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 135d438f-2e66-4e29-bd55-b0f60e578bbf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74272024-12-18T22:22:16.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 135d438f-2e66-4e29-bd55-b0f60e578bbf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74282024-12-18T22:22:16.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 135d438f-2e66-4e29-bd55-b0f60e578bbf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74292024-12-18T22:22:16.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 2cae8032-bbc1-483e-9467-368f6a254fd8 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
74302024-12-18T22:22:17.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f13fde25-46ed-4ccf-9b28-fe291012c697 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74312024-12-18T22:22:17.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f13fde25-46ed-4ccf-9b28-fe291012c697 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74322024-12-18T22:22:17.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f13fde25-46ed-4ccf-9b28-fe291012c697 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74332024-12-18T22:22:18.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 366ffc23-ca2e-4e26-b343-e6cd2fcc7b7a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74342024-12-18T22:22:18.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 366ffc23-ca2e-4e26-b343-e6cd2fcc7b7a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74352024-12-18T22:22:18.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 366ffc23-ca2e-4e26-b343-e6cd2fcc7b7a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74362024-12-18T22:22:19.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 65e61306-2f64-4b88-aa28-4a94cf1966b4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74372024-12-18T22:22:19.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 65e61306-2f64-4b88-aa28-4a94cf1966b4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74382024-12-18T22:22:19.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 65e61306-2f64-4b88-aa28-4a94cf1966b4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74392024-12-18T22:22:20.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 828308db-bd4c-439b-90b2-4fbfde1893a1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74402024-12-18T22:22:20.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 828308db-bd4c-439b-90b2-4fbfde1893a1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74412024-12-18T22:22:20.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 828308db-bd4c-439b-90b2-4fbfde1893a1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74422024-12-18T22:22:21.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5fd8bade-1da7-463e-8002-832bfe984586 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74432024-12-18T22:22:21.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5fd8bade-1da7-463e-8002-832bfe984586 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74442024-12-18T22:22:21.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5fd8bade-1da7-463e-8002-832bfe984586 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74452024-12-18T22:22:22.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07d8d7b8-a9a6-47bc-85c5-c829335d3f55 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74462024-12-18T22:22:22.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07d8d7b8-a9a6-47bc-85c5-c829335d3f55 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74472024-12-18T22:22:22.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07d8d7b8-a9a6-47bc-85c5-c829335d3f55 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74482024-12-18T22:22:23.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b90b6b-e0f0-4b93-8a81-11639346b5c5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74492024-12-18T22:22:23.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b90b6b-e0f0-4b93-8a81-11639346b5c5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74502024-12-18T22:22:23.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b90b6b-e0f0-4b93-8a81-11639346b5c5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74512024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
74522024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74532024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
74542024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74552024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74562024-12-18T22:22:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74572024-12-18T22:22:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-12-18T22:22:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74592024-12-18T22:22:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74602024-12-18T22:22:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74612024-12-18T22:22:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74622024-12-18T22:22:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632024-12-18T22:22:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74642024-12-18T22:22:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
74652024-12-18T22:22:23.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74662024-12-18T22:22:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74672024-12-18T22:22:23.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
74682024-12-18T22:22:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.340209ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
74692024-12-18T22:22:23.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74702024-12-18T22:22:23.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74712024-12-18T22:22:23.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.263783ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74722024-12-18T22:22:24.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b443296-8183-44c6-a74e-0ccea04c825a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74732024-12-18T22:22:24.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b443296-8183-44c6-a74e-0ccea04c825a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74742024-12-18T22:22:24.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8b443296-8183-44c6-a74e-0ccea04c825a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74752024-12-18T22:22:25.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a62206ca-9c0b-482c-87e0-17634baa674e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74762024-12-18T22:22:25.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a62206ca-9c0b-482c-87e0-17634baa674e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74772024-12-18T22:22:25.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a62206ca-9c0b-482c-87e0-17634baa674e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74782024-12-18T22:22:26.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1c4003cf-aef3-496a-b4a2-014b143c4f67 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74792024-12-18T22:22:26.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1c4003cf-aef3-496a-b4a2-014b143c4f67 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74802024-12-18T22:22:26.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1c4003cf-aef3-496a-b4a2-014b143c4f67 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74812024-12-18T22:22:26.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 2bc12dc3-2b3b-4958-a4b5-f951af1caf41 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
74822024-12-18T22:22:27.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b2e9c736-fe33-4214-aac6-807651f5f457 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74832024-12-18T22:22:27.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b2e9c736-fe33-4214-aac6-807651f5f457 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74842024-12-18T22:22:27.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b2e9c736-fe33-4214-aac6-807651f5f457 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74852024-12-18T22:22:28.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e72e3850-cb47-456a-abea-7e46e2147a10 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74862024-12-18T22:22:28.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e72e3850-cb47-456a-abea-7e46e2147a10 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74872024-12-18T22:22:28.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e72e3850-cb47-456a-abea-7e46e2147a10 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74882024-12-18T22:22:29.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 282b58f1-9116-4e72-93b7-6fcc9070604d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74892024-12-18T22:22:29.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 282b58f1-9116-4e72-93b7-6fcc9070604d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74902024-12-18T22:22:29.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 282b58f1-9116-4e72-93b7-6fcc9070604d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74912024-12-18T22:22:30.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6951b73f-71c6-4e83-9fed-0c096a6045e7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74922024-12-18T22:22:30.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6951b73f-71c6-4e83-9fed-0c096a6045e7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74932024-12-18T22:22:30.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6951b73f-71c6-4e83-9fed-0c096a6045e7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74942024-12-18T22:22:31.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e1a9774-f6f2-4ba0-9a15-0460ad20b33e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74952024-12-18T22:22:31.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e1a9774-f6f2-4ba0-9a15-0460ad20b33e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74962024-12-18T22:22:31.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e1a9774-f6f2-4ba0-9a15-0460ad20b33e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74972024-12-18T22:22:32.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44eeadb0-9f81-4fc6-97a1-28629e0a0071 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74982024-12-18T22:22:32.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44eeadb0-9f81-4fc6-97a1-28629e0a0071 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
74992024-12-18T22:22:32.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44eeadb0-9f81-4fc6-97a1-28629e0a0071 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75002024-12-18T22:22:33.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e7fa22d-65a3-418e-a8de-97d28caa7ad8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75012024-12-18T22:22:33.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e7fa22d-65a3-418e-a8de-97d28caa7ad8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75022024-12-18T22:22:33.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9e7fa22d-65a3-418e-a8de-97d28caa7ad8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75032024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
75042024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75052024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
75062024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75072024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75082024-12-18T22:22:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75092024-12-18T22:22:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75102024-12-18T22:22:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75112024-12-18T22:22:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75122024-12-18T22:22:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75132024-12-18T22:22:33.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75142024-12-18T22:22:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75152024-12-18T22:22:33.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75162024-12-18T22:22:33.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
75172024-12-18T22:22:33.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75182024-12-18T22:22:33.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75192024-12-18T22:22:33.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
75202024-12-18T22:22:33.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.131452ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
75212024-12-18T22:22:33.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75222024-12-18T22:22:33.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75232024-12-18T22:22:33.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.946132ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75242024-12-18T22:22:34.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c8cc2d4-f19b-4b64-86d1-6ab6acc71ac9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75252024-12-18T22:22:34.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c8cc2d4-f19b-4b64-86d1-6ab6acc71ac9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75262024-12-18T22:22:34.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c8cc2d4-f19b-4b64-86d1-6ab6acc71ac9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75272024-12-18T22:22:35.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bc689dd3-45fc-41c1-93e4-8ad67bc72912 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75282024-12-18T22:22:35.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bc689dd3-45fc-41c1-93e4-8ad67bc72912 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75292024-12-18T22:22:35.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bc689dd3-45fc-41c1-93e4-8ad67bc72912 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75302024-12-18T22:22:36.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3403dd2d-0b5a-4226-9a1e-6d1abc3ec7d8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75312024-12-18T22:22:36.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3403dd2d-0b5a-4226-9a1e-6d1abc3ec7d8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75322024-12-18T22:22:36.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3403dd2d-0b5a-4226-9a1e-6d1abc3ec7d8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75332024-12-18T22:22:36.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 35715825-92b4-4b83-8358-9e83f4d64642 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
75342024-12-18T22:22:37.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 072aa286-7bfe-4ef7-abf6-fdb66b317d4b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75352024-12-18T22:22:37.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 072aa286-7bfe-4ef7-abf6-fdb66b317d4b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75362024-12-18T22:22:37.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 072aa286-7bfe-4ef7-abf6-fdb66b317d4b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75372024-12-18T22:22:38.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 198b90d3-2f2e-4f26-8d74-6e7af5bd9c0f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75382024-12-18T22:22:38.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 198b90d3-2f2e-4f26-8d74-6e7af5bd9c0f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75392024-12-18T22:22:38.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 198b90d3-2f2e-4f26-8d74-6e7af5bd9c0f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75402024-12-18T22:22:39.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c57f68d2-6dfd-4ad1-bd4c-a30c401f6ba9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75412024-12-18T22:22:39.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c57f68d2-6dfd-4ad1-bd4c-a30c401f6ba9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75422024-12-18T22:22:39.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c57f68d2-6dfd-4ad1-bd4c-a30c401f6ba9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75432024-12-18T22:22:40.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f7f360eb-4c8b-4f1b-874a-148e9ae6d20d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75442024-12-18T22:22:40.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f7f360eb-4c8b-4f1b-874a-148e9ae6d20d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75452024-12-18T22:22:40.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f7f360eb-4c8b-4f1b-874a-148e9ae6d20d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75462024-12-18T22:22:41.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7b560da-5ece-48fe-80a6-77228668376e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75472024-12-18T22:22:41.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7b560da-5ece-48fe-80a6-77228668376e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75482024-12-18T22:22:41.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7b560da-5ece-48fe-80a6-77228668376e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75492024-12-18T22:22:42.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 188035ba-eb29-4ed5-be10-edef95a0d9e8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75502024-12-18T22:22:42.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 188035ba-eb29-4ed5-be10-edef95a0d9e8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75512024-12-18T22:22:42.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 188035ba-eb29-4ed5-be10-edef95a0d9e8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75522024-12-18T22:22:43.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 817523e3-78cd-4c73-9899-fd9b040b7c35 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
75532024-12-18T22:22:43.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 817523e3-78cd-4c73-9899-fd9b040b7c35 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
75542024-12-18T22:22:43.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 817523e3-78cd-4c73-9899-fd9b040b7c35 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
75552024-12-18T22:22:43.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7f7be45-d2ee-46dc-a68f-991f781be62e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75562024-12-18T22:22:43.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7f7be45-d2ee-46dc-a68f-991f781be62e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75572024-12-18T22:22:43.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7f7be45-d2ee-46dc-a68f-991f781be62e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
75582024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
75592024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
75602024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75612024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
75622024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75632024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
75642024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75652024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75662024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
75672024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75682024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75692024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
75702024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75712024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
75722024-12-18T22:22:43.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75732024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
75742024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
75752024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75762024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75772024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
75782024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75792024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
75802024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75812024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
75822024-12-18T22:22:43.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75832024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75842024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
75852024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75862024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
75872024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75882024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
75892024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75902024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
75912024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75922024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
75932024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75942024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75952024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75962024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75972024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75982024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75992024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76002024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76012024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76022024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76032024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76042024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76052024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76062024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76072024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76082024-12-18T22:22:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76092024-12-18T22:22:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.899306ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76102024-12-18T22:22:43.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76112024-12-18T22:22:43.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122024-12-18T22:22:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76132024-12-18T22:22:43.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76142024-12-18T22:22:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76152024-12-18T22:22:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76162024-12-18T22:22:43.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76172024-12-18T22:22:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76182024-12-18T22:22:43.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192024-12-18T22:22:43.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.018077ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
76202024-12-18T22:22:43.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212024-12-18T22:22:43.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 426347824 } })
76222024-12-18T22:22:43.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
76232024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76242024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76252024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76262024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76272024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76282024-12-18T22:22:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76292024-12-18T22:22:43.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 429407555 } })
76302024-12-18T22:22:43.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
76312024-12-18T22:22:43.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76322024-12-18T22:22:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76332024-12-18T22:22:43.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76342024-12-18T22:22:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76352024-12-18T22:22:43.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 432487935 } })
76362024-12-18T22:22:43.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
76372024-12-18T22:22:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76382024-12-18T22:22:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76392024-12-18T22:22:43.843ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76402024-12-18T22:22:43.843ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76412024-12-18T22:22:43.843ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76422024-12-18T22:22:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76432024-12-18T22:22:43.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76442024-12-18T22:22:43.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.248436ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
76452024-12-18T22:22:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76462024-12-18T22:22:43.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76472024-12-18T22:22:43.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-12-18T22:22:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76492024-12-18T22:22:43.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76502024-12-18T22:22:43.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76512024-12-18T22:22:43.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76522024-12-18T22:22:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76532024-12-18T22:22:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76542024-12-18T22:22:43.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76552024-12-18T22:22:43.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76562024-12-18T22:22:43.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76572024-12-18T22:22:43.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76582024-12-18T22:22:43.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76592024-12-18T22:22:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76602024-12-18T22:22:43.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76612024-12-18T22:22:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76622024-12-18T22:22:43.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76632024-12-18T22:22:43.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76642024-12-18T22:22:43.860ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76652024-12-18T22:22:43.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76662024-12-18T22:22:43.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.330962ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76672024-12-18T22:22:43.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76682024-12-18T22:22:43.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76692024-12-18T22:22:43.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76702024-12-18T22:22:43.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76712024-12-18T22:22:43.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76722024-12-18T22:22:43.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.927669ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76732024-12-18T22:22:43.882ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76742024-12-18T22:22:43.882ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76752024-12-18T22:22:43.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76762024-12-18T22:22:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76772024-12-18T22:22:43.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76782024-12-18T22:22:43.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76792024-12-18T22:22:43.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
76802024-12-18T22:22:43.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76812024-12-18T22:22:43.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76822024-12-18T22:22:43.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76832024-12-18T22:22:43.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76842024-12-18T22:22:43.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76852024-12-18T22:22:43.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.414212ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76862024-12-18T22:22:43.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76872024-12-18T22:22:43.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.326169ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76882024-12-18T22:22:43.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
76892024-12-18T22:22:43.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76902024-12-18T22:22:43.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76912024-12-18T22:22:43.894ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76922024-12-18T22:22:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76932024-12-18T22:22:43.895ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58bab982-f98b-49c7-9f05-96bcfcf7d626", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
76942024-12-18T22:22:43.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76952024-12-18T22:22:43.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.403041ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76962024-12-18T22:22:43.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76972024-12-18T22:22:43.899ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.832477ms iteration = 18 status = 0
76982024-12-18T22:22:43.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
76992024-12-18T22:22:43.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77002024-12-18T22:22:43.901ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cccca3bd-c767-460c-8214-64d4d2bd8067", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77012024-12-18T22:22:43.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77022024-12-18T22:22:43.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
77032024-12-18T22:22:43.903ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
77042024-12-18T22:22:43.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.374737ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
77052024-12-18T22:22:43.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77062024-12-18T22:22:43.904ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77072024-12-18T22:22:43.904ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e56da4ee-a28e-4d61-b2b0-0511dba6e1fd", "content-length": "26", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77082024-12-18T22:22:43.904ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77092024-12-18T22:22:43.906ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77102024-12-18T22:22:43.916ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77112024-12-18T22:22:43.916ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77122024-12-18T22:22:43.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.567936ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77132024-12-18T22:22:43.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77142024-12-18T22:22:43.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77152024-12-18T22:22:43.963ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.477576ms iteration = 20 status = {"physical_disks_added":0}
77162024-12-18T22:22:43.984ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77172024-12-18T22:22:43.984ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "947b413b-2d02-4704-b643-32235cf685e3", "content-length": "1", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77182024-12-18T22:22:43.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77192024-12-18T22:22:43.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77202024-12-18T22:22:43.987ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.6628ms iteration = 18 status = {}
77212024-12-18T22:22:43.989ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.485187ms iteration = 18 status = null
77222024-12-18T22:22:44.010ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77232024-12-18T22:22:44.010ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77242024-12-18T22:22:44.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a10627a-b397-462c-b8b9-4e96ef2fd9d9", "content-length": "372", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77252024-12-18T22:22:44.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77262024-12-18T22:22:44.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77272024-12-18T22:22:44.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77282024-12-18T22:22:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77292024-12-18T22:22:44.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77302024-12-18T22:22:44.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77312024-12-18T22:22:44.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77322024-12-18T22:22:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77332024-12-18T22:22:44.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77352024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77362024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77372024-12-18T22:22:44.052ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77382024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77392024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72865174-ac7a-447d-9e6f-fb80b41ffff1", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77402024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77412024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77422024-12-18T22:22:44.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77432024-12-18T22:22:44.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77442024-12-18T22:22:44.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77452024-12-18T22:22:44.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77462024-12-18T22:22:44.055ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
77472024-12-18T22:22:44.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77482024-12-18T22:22:44.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77492024-12-18T22:22:44.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77502024-12-18T22:22:44.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77512024-12-18T22:22:44.061ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77522024-12-18T22:22:44.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77532024-12-18T22:22:44.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "416fdcdc-99ab-4a41-abaa-edb505e476ad", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77542024-12-18T22:22:44.063ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.57553ms iteration = 18 status = {}
77552024-12-18T22:22:44.065ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77562024-12-18T22:22:44.065ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ca13fd0-3ffb-4f0a-9132-c6de645554b6", "content-length": "134", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77572024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77582024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
77592024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77602024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77612024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77622024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77632024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77642024-12-18T22:22:44.065ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77652024-12-18T22:22:44.066ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77662024-12-18T22:22:44.066ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77672024-12-18T22:22:44.066ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
77682024-12-18T22:22:44.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77692024-12-18T22:22:44.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77702024-12-18T22:22:44.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77712024-12-18T22:22:44.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "95c5e2a1-94b4-4fe9-a25a-c33fa137df6f", "content-length": "2", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77722024-12-18T22:22:44.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77732024-12-18T22:22:44.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5df9ac2-7bfd-4091-bdd3-87628c538afb", "content-length": "52", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77742024-12-18T22:22:44.068ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
77752024-12-18T22:22:44.068ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77762024-12-18T22:22:44.144ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77772024-12-18T22:22:44.164ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d17e5f8d-6cbe-4f23-91d3-80dd62cca8da", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77782024-12-18T22:22:44.164ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
77792024-12-18T22:22:44.164ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77802024-12-18T22:22:44.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a43186-01df-433a-9b47-37f88a405ed9", "content-length": "691", "date": "Wed, 18 Dec 2024 22:22:43 GMT"} })
77812024-12-18T22:22:44.165ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
77822024-12-18T22:22:44.165ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77832024-12-18T22:22:44.165ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77842024-12-18T22:22:44.165ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "40d82c9c-2c7f-411f-9baf-59d5754bf9ce", "content-length": "682", "date": "Wed, 18 Dec 2024 22:22:44 GMT"} })
77852024-12-18T22:22:44.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77862024-12-18T22:22:44.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77872024-12-18T22:22:44.167ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 371.636351ms iteration = 18 status = {}
77882024-12-18T22:22:44.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77892024-12-18T22:22:44.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77902024-12-18T22:22:44.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77912024-12-18T22:22:44.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77922024-12-18T22:22:44.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77932024-12-18T22:22:44.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77942024-12-18T22:22:44.181ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 385.958562ms iteration = 18 status = {}
77952024-12-18T22:22:44.460ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
77962024-12-18T22:22:44.460ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
77972024-12-18T22:22:44.491ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
77982024-12-18T22:22:44.491ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39805
77992024-12-18T22:22:44.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39805 req_id = 311c29eb-8145-471c-89bd-d3bfaa09ec95 roles = RoleSet { roles: {} } uri = /metrics/producers
78002024-12-18T22:22:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39805 req_id = 311c29eb-8145-471c-89bd-d3bfaa09ec95 resource = Database result = Ok(()) uri = /metrics/producers
78012024-12-18T22:22:44.560ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
78022024-12-18T22:22:44.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69000 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39805 req_id = 311c29eb-8145-471c-89bd-d3bfaa09ec95 response_code = 201 uri = /metrics/producers
78032024-12-18T22:22:44.560ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "311c29eb-8145-471c-89bd-d3bfaa09ec95", "content-length": "41", "date": "Wed, 18 Dec 2024 22:22:44 GMT"} })
78042024-12-18T22:22:44.562ZDEBGnexus (producer-registration-task): registered with nexus successfully
78052024-12-18T22:22:44.562ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
78062024-12-18T22:22:44.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9200131-73a7-4ef2-9123-9c120d5e032c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78072024-12-18T22:22:44.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9200131-73a7-4ef2-9123-9c120d5e032c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78082024-12-18T22:22:44.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9200131-73a7-4ef2-9123-9c120d5e032c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78092024-12-18T22:22:45.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f2a1d8e-7936-44b1-a02b-5d85082729ca roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78102024-12-18T22:22:45.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f2a1d8e-7936-44b1-a02b-5d85082729ca resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78112024-12-18T22:22:45.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9f2a1d8e-7936-44b1-a02b-5d85082729ca response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78122024-12-18T22:22:46.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 8765a8ca-3bf6-4637-be48-4f28723e075b response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
78132024-12-18T22:22:46.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45779d08-d3ff-4d6e-8f2e-a130e095cc6b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78142024-12-18T22:22:46.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45779d08-d3ff-4d6e-8f2e-a130e095cc6b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78152024-12-18T22:22:46.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45779d08-d3ff-4d6e-8f2e-a130e095cc6b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78162024-12-18T22:22:47.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b9e8c5b-cf61-473c-9b20-c50f09710d45 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78172024-12-18T22:22:47.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b9e8c5b-cf61-473c-9b20-c50f09710d45 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78182024-12-18T22:22:47.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b9e8c5b-cf61-473c-9b20-c50f09710d45 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78192024-12-18T22:22:48.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5349cbbc-4cee-49e2-baef-9c6df95fac43 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78202024-12-18T22:22:48.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5349cbbc-4cee-49e2-baef-9c6df95fac43 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78212024-12-18T22:22:48.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5349cbbc-4cee-49e2-baef-9c6df95fac43 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78222024-12-18T22:22:49.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114038a6-707a-4ca9-ab79-751d361546e9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78232024-12-18T22:22:49.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114038a6-707a-4ca9-ab79-751d361546e9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78242024-12-18T22:22:49.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 114038a6-707a-4ca9-ab79-751d361546e9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78252024-12-18T22:22:50.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ae3d266-d202-414c-b8ad-7b6f2fa42bdd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78262024-12-18T22:22:50.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ae3d266-d202-414c-b8ad-7b6f2fa42bdd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78272024-12-18T22:22:50.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1ae3d266-d202-414c-b8ad-7b6f2fa42bdd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78282024-12-18T22:22:51.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5b56af3-a439-4b74-b881-2d2b5889d49c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78292024-12-18T22:22:51.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5b56af3-a439-4b74-b881-2d2b5889d49c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78302024-12-18T22:22:51.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5b56af3-a439-4b74-b881-2d2b5889d49c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78312024-12-18T22:22:52.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf3a2a58-387e-4ac2-9ff5-693970df9ebf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78322024-12-18T22:22:52.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf3a2a58-387e-4ac2-9ff5-693970df9ebf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78332024-12-18T22:22:52.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf3a2a58-387e-4ac2-9ff5-693970df9ebf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78342024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
78352024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
78362024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78372024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78382024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78392024-12-18T22:22:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78402024-12-18T22:22:53.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78412024-12-18T22:22:53.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78422024-12-18T22:22:53.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78432024-12-18T22:22:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78442024-12-18T22:22:53.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78452024-12-18T22:22:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78462024-12-18T22:22:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78472024-12-18T22:22:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78482024-12-18T22:22:53.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78492024-12-18T22:22:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
78502024-12-18T22:22:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78512024-12-18T22:22:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78522024-12-18T22:22:53.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
78532024-12-18T22:22:53.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.695996ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
78542024-12-18T22:22:53.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.448908ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78552024-12-18T22:22:53.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 19ffc835-7efd-452a-a8cc-cb3c0ae241ff roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78562024-12-18T22:22:53.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 19ffc835-7efd-452a-a8cc-cb3c0ae241ff resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78572024-12-18T22:22:53.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 19ffc835-7efd-452a-a8cc-cb3c0ae241ff response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78582024-12-18T22:22:54.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683904df-210c-4356-ac56-3f3ab3f35b22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78592024-12-18T22:22:54.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683904df-210c-4356-ac56-3f3ab3f35b22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78602024-12-18T22:22:54.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 683904df-210c-4356-ac56-3f3ab3f35b22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78612024-12-18T22:22:55.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb137c46-0164-4a9d-ba24-dd3f3d81e770 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78622024-12-18T22:22:55.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb137c46-0164-4a9d-ba24-dd3f3d81e770 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78632024-12-18T22:22:55.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cb137c46-0164-4a9d-ba24-dd3f3d81e770 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78642024-12-18T22:22:56.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = cde0057f-ef31-4358-99c8-7abc33a607d2 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
78652024-12-18T22:22:56.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24fd6317-6972-4750-b9e7-68ce6b52ba66 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78662024-12-18T22:22:56.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24fd6317-6972-4750-b9e7-68ce6b52ba66 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78672024-12-18T22:22:56.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 24fd6317-6972-4750-b9e7-68ce6b52ba66 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78682024-12-18T22:22:57.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07ee6499-4944-40ef-b2ea-5a622766feea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78692024-12-18T22:22:57.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07ee6499-4944-40ef-b2ea-5a622766feea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78702024-12-18T22:22:57.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 07ee6499-4944-40ef-b2ea-5a622766feea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78712024-12-18T22:22:59.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 08f72d9f-ca76-423f-964a-70632a186e90 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78722024-12-18T22:22:59.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 08f72d9f-ca76-423f-964a-70632a186e90 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78732024-12-18T22:22:59.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 08f72d9f-ca76-423f-964a-70632a186e90 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78742024-12-18T22:23:00.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a1567807-a972-4f54-abe6-22a72c0b235f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78752024-12-18T22:23:00.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a1567807-a972-4f54-abe6-22a72c0b235f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78762024-12-18T22:23:00.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a1567807-a972-4f54-abe6-22a72c0b235f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78772024-12-18T22:23:01.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec286df7-b9d9-4f64-bcca-dec51c3fc6db roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78782024-12-18T22:23:01.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec286df7-b9d9-4f64-bcca-dec51c3fc6db resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78792024-12-18T22:23:01.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec286df7-b9d9-4f64-bcca-dec51c3fc6db response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78802024-12-18T22:23:02.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f653726f-b661-4b0e-b286-0757f7427366 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78812024-12-18T22:23:02.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f653726f-b661-4b0e-b286-0757f7427366 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78822024-12-18T22:23:02.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f653726f-b661-4b0e-b286-0757f7427366 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78832024-12-18T22:23:03.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32cb6ec7-64f4-4882-ae26-311bd7a8304c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78842024-12-18T22:23:03.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32cb6ec7-64f4-4882-ae26-311bd7a8304c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78852024-12-18T22:23:03.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32cb6ec7-64f4-4882-ae26-311bd7a8304c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
78862024-12-18T22:23:03.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
78872024-12-18T22:23:03.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78882024-12-18T22:23:03.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
78892024-12-18T22:23:03.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78902024-12-18T22:23:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78912024-12-18T22:23:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78922024-12-18T22:23:03.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78932024-12-18T22:23:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78942024-12-18T22:23:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78952024-12-18T22:23:03.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78962024-12-18T22:23:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78972024-12-18T22:23:03.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78982024-12-18T22:23:03.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78992024-12-18T22:23:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79002024-12-18T22:23:03.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79012024-12-18T22:23:03.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
79022024-12-18T22:23:03.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79032024-12-18T22:23:03.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79042024-12-18T22:23:03.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
79052024-12-18T22:23:03.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.44496ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
79062024-12-18T22:23:03.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.072929ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79072024-12-18T22:23:04.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d12fd4b4-4a0c-4838-967a-3a9a473122da roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79082024-12-18T22:23:04.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d12fd4b4-4a0c-4838-967a-3a9a473122da resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79092024-12-18T22:23:04.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d12fd4b4-4a0c-4838-967a-3a9a473122da response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79102024-12-18T22:23:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0fd16417-2ce6-4f6c-9d65-34aaba497a8f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79112024-12-18T22:23:05.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0fd16417-2ce6-4f6c-9d65-34aaba497a8f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79122024-12-18T22:23:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0fd16417-2ce6-4f6c-9d65-34aaba497a8f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79132024-12-18T22:23:06.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d32995f6-e3fb-4f8a-a9a2-893d2dd0ea88 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79142024-12-18T22:23:06.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d32995f6-e3fb-4f8a-a9a2-893d2dd0ea88 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79152024-12-18T22:23:06.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d32995f6-e3fb-4f8a-a9a2-893d2dd0ea88 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79162024-12-18T22:23:06.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 62bc97ee-ddd4-4fe5-a27d-7e4b6c81f25a response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
79172024-12-18T22:23:07.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50f0a643-2179-4d40-9d69-d2af9ff0ad7f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79182024-12-18T22:23:07.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50f0a643-2179-4d40-9d69-d2af9ff0ad7f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79192024-12-18T22:23:07.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 50f0a643-2179-4d40-9d69-d2af9ff0ad7f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79202024-12-18T22:23:08.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cab55ec8-573a-409b-a458-b97edb708db8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79212024-12-18T22:23:08.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cab55ec8-573a-409b-a458-b97edb708db8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79222024-12-18T22:23:08.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cab55ec8-573a-409b-a458-b97edb708db8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79232024-12-18T22:23:09.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88f5e280-2c9e-45c8-ba95-dd2bca0790de roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79242024-12-18T22:23:09.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88f5e280-2c9e-45c8-ba95-dd2bca0790de resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79252024-12-18T22:23:09.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 88f5e280-2c9e-45c8-ba95-dd2bca0790de response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79262024-12-18T22:23:10.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee283a9d-8b40-4ad4-916d-a45f8082da10 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79272024-12-18T22:23:10.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee283a9d-8b40-4ad4-916d-a45f8082da10 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79282024-12-18T22:23:10.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ee283a9d-8b40-4ad4-916d-a45f8082da10 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79292024-12-18T22:23:11.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 10aaa5bc-af3c-4ba8-88ad-4f24f3bd1d3d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79302024-12-18T22:23:11.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 10aaa5bc-af3c-4ba8-88ad-4f24f3bd1d3d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79312024-12-18T22:23:11.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 10aaa5bc-af3c-4ba8-88ad-4f24f3bd1d3d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79322024-12-18T22:23:12.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dcfc5ceb-cf8b-424d-91fb-d4939029bca5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79332024-12-18T22:23:12.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dcfc5ceb-cf8b-424d-91fb-d4939029bca5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79342024-12-18T22:23:12.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dcfc5ceb-cf8b-424d-91fb-d4939029bca5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79352024-12-18T22:23:13.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d146202-629c-4b59-9362-d56f01c04036 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79362024-12-18T22:23:13.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d146202-629c-4b59-9362-d56f01c04036 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79372024-12-18T22:23:13.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d146202-629c-4b59-9362-d56f01c04036 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
79382024-12-18T22:23:13.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2d2a7f4a-7e97-47e0-8c12-6369356f2646 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
79392024-12-18T22:23:13.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2d2a7f4a-7e97-47e0-8c12-6369356f2646 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
79402024-12-18T22:23:13.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2d2a7f4a-7e97-47e0-8c12-6369356f2646 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
79412024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
79422024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
79432024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
79442024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79452024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79462024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79472024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
79482024-12-18T22:23:13.795ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
79492024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
79502024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
79512024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79522024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
79532024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79542024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
79552024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
79562024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
79572024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79582024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
79592024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79602024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
79612024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79622024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
79632024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
79642024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
79652024-12-18T22:23:13.795ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
79662024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.61\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
79672024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
79682024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79692024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
79702024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79712024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
79722024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
79732024-12-18T22:23:13.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79742024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79752024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
79762024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
79772024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79782024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
79792024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79802024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79812024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
79822024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
79832024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79842024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79852024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79862024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79872024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
79882024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
79892024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
79902024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79912024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
79922024-12-18T22:23:13.796ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:13:13.795984732 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79932024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79942024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
79952024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
79962024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
79972024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
79982024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79992024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
80002024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80012024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80022024-12-18T22:23:13.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80032024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80042024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
80052024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80062024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80072024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80082024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80092024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80102024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80112024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80122024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80132024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80142024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80152024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80162024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80172024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80182024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80192024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80202024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80212024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
80222024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80232024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80242024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80252024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80262024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80272024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80282024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80292024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80302024-12-18T22:23:13.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 415733356 } })
80312024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80322024-12-18T22:23:13.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 415776927 } })
80332024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80342024-12-18T22:23:13.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80352024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80362024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80372024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
80382024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80392024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.209404ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
80402024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80412024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
80422024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.437128ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
80432024-12-18T22:23:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80442024-12-18T22:23:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80452024-12-18T22:23:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80462024-12-18T22:23:13.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80472024-12-18T22:23:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.423947ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
80482024-12-18T22:23:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.463878ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80492024-12-18T22:23:13.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80502024-12-18T22:23:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80512024-12-18T22:23:13.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80522024-12-18T22:23:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80532024-12-18T22:23:13.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80542024-12-18T22:23:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80552024-12-18T22:23:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80562024-12-18T22:23:13.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80572024-12-18T22:23:13.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80582024-12-18T22:23:13.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80592024-12-18T22:23:13.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80602024-12-18T22:23:13.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 425187452 } })
80612024-12-18T22:23:13.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
80622024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
80632024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80642024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80652024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80662024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80672024-12-18T22:23:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80682024-12-18T22:23:13.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 428748562 } })
80692024-12-18T22:23:13.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
80702024-12-18T22:23:13.810ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80712024-12-18T22:23:13.810ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80722024-12-18T22:23:13.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80732024-12-18T22:23:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80742024-12-18T22:23:13.813ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:13:13.795984732 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80752024-12-18T22:23:13.813ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.528744ms iteration = 10 status = {"expiration":"2024-12-18T22:13:13.795984732Z","pruned":[]}
80762024-12-18T22:23:13.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80772024-12-18T22:23:13.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80782024-12-18T22:23:13.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80792024-12-18T22:23:13.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80802024-12-18T22:23:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80812024-12-18T22:23:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80822024-12-18T22:23:13.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80832024-12-18T22:23:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80842024-12-18T22:23:13.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80852024-12-18T22:23:13.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80862024-12-18T22:23:13.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
80872024-12-18T22:23:13.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80882024-12-18T22:23:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80892024-12-18T22:23:13.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80902024-12-18T22:23:13.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 442068683 } })
80912024-12-18T22:23:13.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
80922024-12-18T22:23:13.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
80932024-12-18T22:23:13.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80942024-12-18T22:23:13.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80952024-12-18T22:23:13.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80962024-12-18T22:23:13.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80972024-12-18T22:23:13.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80982024-12-18T22:23:13.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80992024-12-18T22:23:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81002024-12-18T22:23:13.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.625785ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
81012024-12-18T22:23:13.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81022024-12-18T22:23:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81032024-12-18T22:23:13.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81042024-12-18T22:23:13.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81052024-12-18T22:23:13.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81062024-12-18T22:23:13.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81072024-12-18T22:23:13.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81082024-12-18T22:23:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81092024-12-18T22:23:13.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81102024-12-18T22:23:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81112024-12-18T22:23:13.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81122024-12-18T22:23:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81132024-12-18T22:23:13.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-12-18T22:23:13.859ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
81152024-12-18T22:23:13.859ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
81162024-12-18T22:23:13.859ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.858502ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
81172024-12-18T22:23:13.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81182024-12-18T22:23:13.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81192024-12-18T22:23:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81202024-12-18T22:23:13.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81212024-12-18T22:23:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81222024-12-18T22:23:13.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81232024-12-18T22:23:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81242024-12-18T22:23:13.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81252024-12-18T22:23:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81262024-12-18T22:23:13.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81272024-12-18T22:23:13.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81282024-12-18T22:23:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81292024-12-18T22:23:13.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81302024-12-18T22:23:13.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81312024-12-18T22:23:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81322024-12-18T22:23:13.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81332024-12-18T22:23:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81342024-12-18T22:23:13.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81352024-12-18T22:23:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81362024-12-18T22:23:13.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81372024-12-18T22:23:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81382024-12-18T22:23:13.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81392024-12-18T22:23:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81402024-12-18T22:23:13.878ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81412024-12-18T22:23:13.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.828986ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81422024-12-18T22:23:13.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81432024-12-18T22:23:13.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81442024-12-18T22:23:13.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81452024-12-18T22:23:13.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81462024-12-18T22:23:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81472024-12-18T22:23:13.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81482024-12-18T22:23:13.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492024-12-18T22:23:13.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.125199ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
81502024-12-18T22:23:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
81512024-12-18T22:23:13.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81522024-12-18T22:23:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81532024-12-18T22:23:13.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81542024-12-18T22:23:13.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81552024-12-18T22:23:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81562024-12-18T22:23:13.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81572024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81582024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81592024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81602024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 89.798642ms iteration = 5 status = {"nsuccess":5}
81612024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81622024-12-18T22:23:13.885ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81632024-12-18T22:23:13.885ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.245451ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81642024-12-18T22:23:13.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81652024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81662024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81672024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81682024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81692024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81702024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81712024-12-18T22:23:13.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81722024-12-18T22:23:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81732024-12-18T22:23:13.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.28857ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81742024-12-18T22:23:13.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81752024-12-18T22:23:13.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81762024-12-18T22:23:13.893ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81772024-12-18T22:23:13.893ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81782024-12-18T22:23:13.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81792024-12-18T22:23:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81802024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81812024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81822024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81832024-12-18T22:23:13.896ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81842024-12-18T22:23:13.896ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81852024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.368219ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81862024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
81872024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81882024-12-18T22:23:13.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81892024-12-18T22:23:13.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81902024-12-18T22:23:13.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81912024-12-18T22:23:13.898ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
81922024-12-18T22:23:13.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81932024-12-18T22:23:13.898ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.505501ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
81942024-12-18T22:23:13.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81952024-12-18T22:23:13.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81962024-12-18T22:23:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81972024-12-18T22:23:13.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81982024-12-18T22:23:13.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81992024-12-18T22:23:13.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82002024-12-18T22:23:13.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82012024-12-18T22:23:13.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.860528ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82022024-12-18T22:23:13.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82032024-12-18T22:23:13.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82042024-12-18T22:23:13.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82052024-12-18T22:23:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82062024-12-18T22:23:13.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82072024-12-18T22:23:13.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82082024-12-18T22:23:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82092024-12-18T22:23:13.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82102024-12-18T22:23:13.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82112024-12-18T22:23:13.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82122024-12-18T22:23:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82132024-12-18T22:23:13.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
82142024-12-18T22:23:13.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82152024-12-18T22:23:13.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82162024-12-18T22:23:13.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.526438ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82172024-12-18T22:23:13.908ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.683651ms iteration = 19 status = 0
82182024-12-18T22:23:13.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82192024-12-18T22:23:13.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82202024-12-18T22:23:13.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82212024-12-18T22:23:13.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82222024-12-18T22:23:13.919ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
82232024-12-18T22:23:13.919ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
82242024-12-18T22:23:13.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82252024-12-18T22:23:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82262024-12-18T22:23:13.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82272024-12-18T22:23:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82282024-12-18T22:23:13.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82292024-12-18T22:23:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82302024-12-18T22:23:13.931ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
82312024-12-18T22:23:13.931ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82322024-12-18T22:23:13.931ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
82332024-12-18T22:23:13.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.736713ms iteration = 10 status = {"generation":2}
82342024-12-18T22:23:13.937ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
82352024-12-18T22:23:13.937ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82362024-12-18T22:23:13.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82372024-12-18T22:23:13.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82382024-12-18T22:23:13.945ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
82392024-12-18T22:23:13.945ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 149.258499ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
82402024-12-18T22:23:13.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.39261ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82412024-12-18T22:23:13.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
82422024-12-18T22:23:13.983ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
82432024-12-18T22:23:13.983ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.524539ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
82442024-12-18T22:23:13.991ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.631878ms iteration = 21 status = {"physical_disks_added":0}
82452024-12-18T22:23:14.005ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82462024-12-18T22:23:14.005ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82472024-12-18T22:23:14.005ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b4c49fc-c14e-48aa-8335-ecf8dc14a2ed", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:13 GMT"} })
82482024-12-18T22:23:14.005ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82492024-12-18T22:23:14.005ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82502024-12-18T22:23:14.005ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82512024-12-18T22:23:14.006ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6689943e-0a4d-4271-ba9b-87f27d20838c", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:13 GMT"} })
82522024-12-18T22:23:14.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82532024-12-18T22:23:14.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82542024-12-18T22:23:14.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82552024-12-18T22:23:14.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82562024-12-18T22:23:14.111ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82572024-12-18T22:23:14.112ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa137fa-5702-456e-9bd7-5b01921639b3", "content-length": "691", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
82582024-12-18T22:23:14.112ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82592024-12-18T22:23:14.112ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82602024-12-18T22:23:14.112ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82612024-12-18T22:23:14.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82622024-12-18T22:23:14.114ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.605361ms iteration = 19 status = {}
82632024-12-18T22:23:14.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82642024-12-18T22:23:14.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82652024-12-18T22:23:14.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82662024-12-18T22:23:14.118ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82672024-12-18T22:23:14.118ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82682024-12-18T22:23:14.118ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
82692024-12-18T22:23:14.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.916316ms iteration = 10 status = {"generation":1}
82702024-12-18T22:23:14.142ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
82712024-12-18T22:23:14.142ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82722024-12-18T22:23:14.143ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3137735-e80d-4205-9468-d7600632a381", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:13 GMT"} })
82732024-12-18T22:23:14.143ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82742024-12-18T22:23:14.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
82752024-12-18T22:23:14.196ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.687712ms iteration = 19 status = {}
82762024-12-18T22:23:14.197ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82772024-12-18T22:23:14.198ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebd228bc-e96b-441c-ad8e-50697f34d76e", "content-length": "1", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
82782024-12-18T22:23:14.198ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82792024-12-18T22:23:14.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82802024-12-18T22:23:14.200ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.583738ms iteration = 19 status = null
82812024-12-18T22:23:14.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
82822024-12-18T22:23:14.274ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82832024-12-18T22:23:14.274ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "08a34934-f97d-4015-88f9-12fc3917c573", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82842024-12-18T22:23:14.274ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82852024-12-18T22:23:14.276ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b03186ce-7c35-4c0e-bb4d-5ef7db9cf24b", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82862024-12-18T22:23:14.276ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82872024-12-18T22:23:14.277ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82882024-12-18T22:23:14.277ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 481.567249ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
82892024-12-18T22:23:14.278ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82902024-12-18T22:23:14.278ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82912024-12-18T22:23:14.278ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8fbff8e-f707-471e-aed9-005ad37cde33", "content-length": "372", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
82922024-12-18T22:23:14.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82932024-12-18T22:23:14.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82942024-12-18T22:23:14.292ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
82952024-12-18T22:23:14.292ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82962024-12-18T22:23:14.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "87878fbe-327f-4e8a-a1cb-b2b7321876bc", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
82972024-12-18T22:23:14.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82982024-12-18T22:23:14.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82992024-12-18T22:23:14.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83002024-12-18T22:23:14.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83012024-12-18T22:23:14.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83022024-12-18T22:23:14.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83032024-12-18T22:23:14.301ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83042024-12-18T22:23:14.301ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83052024-12-18T22:23:14.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a89f0d8-64f8-4adc-ac70-934c7ebf5541", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83062024-12-18T22:23:14.303ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.735862ms iteration = 19 status = {}
83072024-12-18T22:23:14.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
83082024-12-18T22:23:14.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f09e173b-7352-4627-9c7e-707ce5fa4250", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83092024-12-18T22:23:14.330ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83102024-12-18T22:23:14.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "376075ba-e225-4105-bf0a-d98c66b524b2", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83112024-12-18T22:23:14.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83122024-12-18T22:23:14.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0a2946a2-7331-4890-86c3-4e87e40ad8ab", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83132024-12-18T22:23:14.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83142024-12-18T22:23:14.334ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
83152024-12-18T22:23:14.334ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 539.198019ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
83162024-12-18T22:23:14.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83172024-12-18T22:23:14.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83182024-12-18T22:23:14.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
83192024-12-18T22:23:14.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83202024-12-18T22:23:14.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83212024-12-18T22:23:14.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83222024-12-18T22:23:14.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb750218-9fa7-4890-a23e-0f22eeb1dd88", "content-length": "134", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83232024-12-18T22:23:14.377ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83242024-12-18T22:23:14.377ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
83252024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83262024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83272024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83282024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83292024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83302024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83312024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83322024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83332024-12-18T22:23:14.378ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
83342024-12-18T22:23:14.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83352024-12-18T22:23:14.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83362024-12-18T22:23:14.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83372024-12-18T22:23:14.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e18c14-77b1-466e-b4cd-64ac842971c4", "content-length": "2", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83382024-12-18T22:23:14.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83392024-12-18T22:23:14.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "71871104-ebf8-4744-8b2f-22c37ba38ff8", "content-length": "52", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83402024-12-18T22:23:14.380ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
83412024-12-18T22:23:14.380ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83422024-12-18T22:23:14.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff5546ce-a64b-426b-aa2a-8805f6347e2b", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83432024-12-18T22:23:14.478ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
83442024-12-18T22:23:14.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83452024-12-18T22:23:14.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 273e1e9e-a484-457d-b4b5-5d9d8673f644 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83462024-12-18T22:23:14.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 273e1e9e-a484-457d-b4b5-5d9d8673f644 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83472024-12-18T22:23:14.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "790aaba1-7f37-419f-9748-f151fedb1560", "content-length": "682", "date": "Wed, 18 Dec 2024 22:23:14 GMT"} })
83482024-12-18T22:23:14.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83492024-12-18T22:23:14.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83502024-12-18T22:23:14.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 273e1e9e-a484-457d-b4b5-5d9d8673f644 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83512024-12-18T22:23:14.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83522024-12-18T22:23:14.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83532024-12-18T22:23:14.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83542024-12-18T22:23:14.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83552024-12-18T22:23:14.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83562024-12-18T22:23:14.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83572024-12-18T22:23:14.495ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.984564ms iteration = 19 status = {}
83582024-12-18T22:23:15.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a238376e-ad9e-4de6-9e89-5abd43baae8b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83592024-12-18T22:23:15.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a238376e-ad9e-4de6-9e89-5abd43baae8b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83602024-12-18T22:23:15.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a238376e-ad9e-4de6-9e89-5abd43baae8b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83612024-12-18T22:23:16.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8773e1c6-4eb4-4384-874a-3ad1b1a57a75 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83622024-12-18T22:23:16.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8773e1c6-4eb4-4384-874a-3ad1b1a57a75 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83632024-12-18T22:23:16.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8773e1c6-4eb4-4384-874a-3ad1b1a57a75 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83642024-12-18T22:23:16.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 574 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5c86ac51-560b-4ee3-8f04-23e5de85f9b9 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
83652024-12-18T22:23:17.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8376004a-1511-4686-a248-3cec912015eb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83662024-12-18T22:23:17.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8376004a-1511-4686-a248-3cec912015eb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83672024-12-18T22:23:17.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8376004a-1511-4686-a248-3cec912015eb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83682024-12-18T22:23:18.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20ca66d4-c36c-42b0-b14c-ae6d954f6801 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83692024-12-18T22:23:18.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20ca66d4-c36c-42b0-b14c-ae6d954f6801 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83702024-12-18T22:23:18.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 20ca66d4-c36c-42b0-b14c-ae6d954f6801 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83712024-12-18T22:23:19.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f89edf0-029b-46f9-be24-ee8758f626ef roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83722024-12-18T22:23:19.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f89edf0-029b-46f9-be24-ee8758f626ef resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83732024-12-18T22:23:19.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f89edf0-029b-46f9-be24-ee8758f626ef response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83742024-12-18T22:23:20.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e6e6c9f5-b539-42ad-b81c-65cc082ae770 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83752024-12-18T22:23:20.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e6e6c9f5-b539-42ad-b81c-65cc082ae770 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83762024-12-18T22:23:20.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e6e6c9f5-b539-42ad-b81c-65cc082ae770 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83772024-12-18T22:23:21.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e96b44dd-77aa-4e07-9a2d-f1d30a8452b3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83782024-12-18T22:23:21.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e96b44dd-77aa-4e07-9a2d-f1d30a8452b3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83792024-12-18T22:23:21.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e96b44dd-77aa-4e07-9a2d-f1d30a8452b3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83802024-12-18T22:23:22.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85239a4d-a1ed-4319-91e3-6df3e31dc616 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83812024-12-18T22:23:22.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85239a4d-a1ed-4319-91e3-6df3e31dc616 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83822024-12-18T22:23:22.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85239a4d-a1ed-4319-91e3-6df3e31dc616 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83832024-12-18T22:23:23.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9799d601-551d-40a1-a1e9-d024bd1e939d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83842024-12-18T22:23:23.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9799d601-551d-40a1-a1e9-d024bd1e939d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83852024-12-18T22:23:23.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9799d601-551d-40a1-a1e9-d024bd1e939d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
83862024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
83872024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
83882024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83892024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83902024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83912024-12-18T22:23:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83922024-12-18T22:23:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83932024-12-18T22:23:23.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83942024-12-18T22:23:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83952024-12-18T22:23:23.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.275844ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83962024-12-18T22:23:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83972024-12-18T22:23:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83982024-12-18T22:23:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83992024-12-18T22:23:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84002024-12-18T22:23:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84012024-12-18T22:23:23.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84022024-12-18T22:23:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
84032024-12-18T22:23:23.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84042024-12-18T22:23:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052024-12-18T22:23:23.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
84062024-12-18T22:23:23.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.783428ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
84072024-12-18T22:23:24.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33207565-10c7-4936-9fcc-7ef4fcc5e09b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84082024-12-18T22:23:24.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33207565-10c7-4936-9fcc-7ef4fcc5e09b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84092024-12-18T22:23:24.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33207565-10c7-4936-9fcc-7ef4fcc5e09b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84102024-12-18T22:23:25.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5470f9e-7d1d-4238-8a1e-290da64a68dd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84112024-12-18T22:23:25.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5470f9e-7d1d-4238-8a1e-290da64a68dd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84122024-12-18T22:23:25.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f5470f9e-7d1d-4238-8a1e-290da64a68dd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84132024-12-18T22:23:26.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 0a36de21-a668-4d96-b168-9d4623be2334 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
84142024-12-18T22:23:26.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed371fd2-b0ed-4d6b-8a1a-81151f8457ff roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84152024-12-18T22:23:26.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed371fd2-b0ed-4d6b-8a1a-81151f8457ff resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84162024-12-18T22:23:26.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed371fd2-b0ed-4d6b-8a1a-81151f8457ff response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84172024-12-18T22:23:27.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b9cfcc17-b725-4081-a605-b703d513c733 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84182024-12-18T22:23:27.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b9cfcc17-b725-4081-a605-b703d513c733 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84192024-12-18T22:23:27.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b9cfcc17-b725-4081-a605-b703d513c733 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84202024-12-18T22:23:28.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18e49143-1600-4204-8231-94f5ba55dc4d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84212024-12-18T22:23:28.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18e49143-1600-4204-8231-94f5ba55dc4d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84222024-12-18T22:23:28.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18e49143-1600-4204-8231-94f5ba55dc4d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84232024-12-18T22:23:29.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 544d7f70-3076-441e-bf7f-d3b372308d34 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84242024-12-18T22:23:29.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 544d7f70-3076-441e-bf7f-d3b372308d34 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84252024-12-18T22:23:29.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 544d7f70-3076-441e-bf7f-d3b372308d34 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84262024-12-18T22:23:30.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4322a54-e1ab-4e5c-a4e0-14de9233542c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84272024-12-18T22:23:30.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4322a54-e1ab-4e5c-a4e0-14de9233542c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84282024-12-18T22:23:30.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a4322a54-e1ab-4e5c-a4e0-14de9233542c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84292024-12-18T22:23:31.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 032b8ebd-938b-487d-9690-d43892566650 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84302024-12-18T22:23:31.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 032b8ebd-938b-487d-9690-d43892566650 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84312024-12-18T22:23:31.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 032b8ebd-938b-487d-9690-d43892566650 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84322024-12-18T22:23:32.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79a6de6b-fdce-4ea6-9d39-6d3611ebe47c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84332024-12-18T22:23:32.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79a6de6b-fdce-4ea6-9d39-6d3611ebe47c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84342024-12-18T22:23:32.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 79a6de6b-fdce-4ea6-9d39-6d3611ebe47c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84352024-12-18T22:23:33.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
84362024-12-18T22:23:33.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84372024-12-18T22:23:33.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
84382024-12-18T22:23:33.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84392024-12-18T22:23:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84402024-12-18T22:23:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84412024-12-18T22:23:33.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84422024-12-18T22:23:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84432024-12-18T22:23:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84442024-12-18T22:23:33.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.5773ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84452024-12-18T22:23:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84462024-12-18T22:23:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84472024-12-18T22:23:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84482024-12-18T22:23:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84492024-12-18T22:23:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84502024-12-18T22:23:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84512024-12-18T22:23:33.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
84522024-12-18T22:23:33.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84532024-12-18T22:23:33.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84542024-12-18T22:23:33.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
84552024-12-18T22:23:33.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.522662ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
84562024-12-18T22:23:33.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b130ad1-af07-4778-95e6-c999bbc87b63 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84572024-12-18T22:23:33.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b130ad1-af07-4778-95e6-c999bbc87b63 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84582024-12-18T22:23:33.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3b130ad1-af07-4778-95e6-c999bbc87b63 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84592024-12-18T22:23:34.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4e60ecc-3aab-4eeb-9246-d4f0a257cd74 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84602024-12-18T22:23:34.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4e60ecc-3aab-4eeb-9246-d4f0a257cd74 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84612024-12-18T22:23:34.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4e60ecc-3aab-4eeb-9246-d4f0a257cd74 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84622024-12-18T22:23:35.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd203b10-bd19-4283-a7c1-247b7031ea0e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84632024-12-18T22:23:35.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd203b10-bd19-4283-a7c1-247b7031ea0e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84642024-12-18T22:23:35.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd203b10-bd19-4283-a7c1-247b7031ea0e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84652024-12-18T22:23:36.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 75f35884-24c9-4672-8b2f-b73cfa168eab response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
84662024-12-18T22:23:36.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 464343ca-8c21-45dd-b992-53f3ef69954c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84672024-12-18T22:23:36.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 464343ca-8c21-45dd-b992-53f3ef69954c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84682024-12-18T22:23:36.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 464343ca-8c21-45dd-b992-53f3ef69954c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84692024-12-18T22:23:37.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1dc1a3aa-f939-43ed-87e8-ff9b27d6e666 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84702024-12-18T22:23:37.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1dc1a3aa-f939-43ed-87e8-ff9b27d6e666 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84712024-12-18T22:23:37.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1dc1a3aa-f939-43ed-87e8-ff9b27d6e666 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84722024-12-18T22:23:39.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31f43c7b-9946-45c2-9a85-e1374cb3f0c3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84732024-12-18T22:23:39.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31f43c7b-9946-45c2-9a85-e1374cb3f0c3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84742024-12-18T22:23:39.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31f43c7b-9946-45c2-9a85-e1374cb3f0c3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84752024-12-18T22:23:40.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 89370dde-c50b-4406-9d69-3dd2a2d87475 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84762024-12-18T22:23:40.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 89370dde-c50b-4406-9d69-3dd2a2d87475 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84772024-12-18T22:23:40.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 89370dde-c50b-4406-9d69-3dd2a2d87475 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84782024-12-18T22:23:41.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a84805-d438-4611-80c8-88e56a3f50ab roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84792024-12-18T22:23:41.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a84805-d438-4611-80c8-88e56a3f50ab resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84802024-12-18T22:23:41.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 60a84805-d438-4611-80c8-88e56a3f50ab response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84812024-12-18T22:23:42.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 331d6467-f5b3-46af-8f2b-d2a514b27821 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84822024-12-18T22:23:42.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 331d6467-f5b3-46af-8f2b-d2a514b27821 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84832024-12-18T22:23:42.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 331d6467-f5b3-46af-8f2b-d2a514b27821 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84842024-12-18T22:23:43.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87725e0d-e728-49b9-a62e-b74c38b723c9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84852024-12-18T22:23:43.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87725e0d-e728-49b9-a62e-b74c38b723c9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84862024-12-18T22:23:43.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87725e0d-e728-49b9-a62e-b74c38b723c9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
84872024-12-18T22:23:43.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 65e1375c-a8ca-4b84-a4be-7448ec4c8488 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
84882024-12-18T22:23:43.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 65e1375c-a8ca-4b84-a4be-7448ec4c8488 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
84892024-12-18T22:23:43.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 65e1375c-a8ca-4b84-a4be-7448ec4c8488 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
84902024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
84912024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
84922024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84932024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84942024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
84952024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84962024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
84972024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84982024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
84992024-12-18T22:23:43.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85002024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
85012024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85022024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
85032024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85042024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85052024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
85062024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85072024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
85082024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85092024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85102024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
85112024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85122024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
85132024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85142024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
85152024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
85162024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85172024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85182024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
85192024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
85202024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85212024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
85222024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
85232024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85242024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85252024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85262024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85272024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85282024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85292024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85302024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85312024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85322024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85332024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85342024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85352024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85362024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85372024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85382024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85392024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85402024-12-18T22:23:43.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85412024-12-18T22:23:43.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.202913ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
85422024-12-18T22:23:43.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.305135ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85432024-12-18T22:23:43.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85442024-12-18T22:23:43.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452024-12-18T22:23:43.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.335964ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
85462024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85472024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85482024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85492024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85502024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85512024-12-18T22:23:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85522024-12-18T22:23:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85532024-12-18T22:23:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85542024-12-18T22:23:43.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85552024-12-18T22:23:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85562024-12-18T22:23:43.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85572024-12-18T22:23:43.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85582024-12-18T22:23:43.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85592024-12-18T22:23:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85602024-12-18T22:23:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85612024-12-18T22:23:43.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85622024-12-18T22:23:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85632024-12-18T22:23:43.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85642024-12-18T22:23:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85652024-12-18T22:23:43.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85662024-12-18T22:23:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85672024-12-18T22:23:43.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 428698151 } })
85682024-12-18T22:23:43.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85692024-12-18T22:23:43.811ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85702024-12-18T22:23:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85712024-12-18T22:23:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85722024-12-18T22:23:43.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85732024-12-18T22:23:43.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 430662639 } })
85742024-12-18T22:23:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85752024-12-18T22:23:43.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85762024-12-18T22:23:43.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85772024-12-18T22:23:43.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85782024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85792024-12-18T22:23:43.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 433136248 } })
85802024-12-18T22:23:43.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
85812024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85822024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85832024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85842024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85852024-12-18T22:23:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85862024-12-18T22:23:43.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85872024-12-18T22:23:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85882024-12-18T22:23:43.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.868239ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85892024-12-18T22:23:43.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85902024-12-18T22:23:43.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85912024-12-18T22:23:43.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85922024-12-18T22:23:43.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-12-18T22:23:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85942024-12-18T22:23:43.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85952024-12-18T22:23:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85962024-12-18T22:23:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
85972024-12-18T22:23:43.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85982024-12-18T22:23:43.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85992024-12-18T22:23:43.831ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86002024-12-18T22:23:43.831ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86012024-12-18T22:23:43.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86022024-12-18T22:23:43.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86032024-12-18T22:23:43.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86042024-12-18T22:23:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86052024-12-18T22:23:43.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86062024-12-18T22:23:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86072024-12-18T22:23:43.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86082024-12-18T22:23:43.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86092024-12-18T22:23:43.851ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86102024-12-18T22:23:43.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.807086ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86112024-12-18T22:23:43.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 57.720883ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86122024-12-18T22:23:43.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86132024-12-18T22:23:43.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86142024-12-18T22:23:43.917ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.086325ms iteration = 22 status = {"physical_disks_added":0}
86152024-12-18T22:23:43.924ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86162024-12-18T22:23:43.924ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86172024-12-18T22:23:43.924ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bde87d5-3e0f-4d31-bfb9-d7444b52f81a", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86182024-12-18T22:23:43.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86192024-12-18T22:23:43.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86202024-12-18T22:23:43.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86212024-12-18T22:23:43.926ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "124289ea-0b7a-46f8-be05-336978d5ac30", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86222024-12-18T22:23:43.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86232024-12-18T22:23:43.927ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86242024-12-18T22:23:43.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86252024-12-18T22:23:43.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
86262024-12-18T22:23:43.928ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86272024-12-18T22:23:43.929ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ef217a9-6c92-4cbb-8058-9966b25e545d", "content-length": "26", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86282024-12-18T22:23:43.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86292024-12-18T22:23:43.929ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86302024-12-18T22:23:43.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86312024-12-18T22:23:43.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
86322024-12-18T22:23:43.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d807099f-4ca2-43d7-b4cc-eaf7724f61d0", "content-length": "372", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86332024-12-18T22:23:43.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86342024-12-18T22:23:43.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86352024-12-18T22:23:43.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.957937ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86362024-12-18T22:23:43.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86372024-12-18T22:23:43.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86382024-12-18T22:23:43.939ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
86392024-12-18T22:23:43.939ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 143.579337ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
86402024-12-18T22:23:43.959ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86412024-12-18T22:23:43.959ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86422024-12-18T22:23:43.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86432024-12-18T22:23:43.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86442024-12-18T22:23:43.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452024-12-18T22:23:43.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 164.998247ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86462024-12-18T22:23:43.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
86472024-12-18T22:23:43.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86482024-12-18T22:23:43.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86492024-12-18T22:23:43.964ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 168.289422ms iteration = 20 status = 0
86502024-12-18T22:23:43.974ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86512024-12-18T22:23:43.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86522024-12-18T22:23:43.974ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3e77e014-0030-487b-8291-572e6839688b", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86532024-12-18T22:23:43.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86542024-12-18T22:23:43.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86552024-12-18T22:23:43.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86562024-12-18T22:23:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86572024-12-18T22:23:43.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86582024-12-18T22:23:43.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86592024-12-18T22:23:43.986ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86602024-12-18T22:23:43.986ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86612024-12-18T22:23:43.987ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86bb2962-2930-412b-b524-881617bfbbd6", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86622024-12-18T22:23:43.988ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 192.246672ms iteration = 20 status = {}
86632024-12-18T22:23:43.992ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86642024-12-18T22:23:43.992ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86652024-12-18T22:23:43.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.292832ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86662024-12-18T22:23:44.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86672024-12-18T22:23:44.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86682024-12-18T22:23:44.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86692024-12-18T22:23:44.032ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86702024-12-18T22:23:44.032ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "211280b6-f7ea-40b0-9c70-361ce41aece3", "content-length": "1", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86712024-12-18T22:23:44.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86722024-12-18T22:23:44.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86732024-12-18T22:23:44.033ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86742024-12-18T22:23:44.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86752024-12-18T22:23:44.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86762024-12-18T22:23:44.036ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.05353ms iteration = 20 status = null
86772024-12-18T22:23:44.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86782024-12-18T22:23:44.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86792024-12-18T22:23:44.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86802024-12-18T22:23:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86812024-12-18T22:23:44.075ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.856981ms iteration = 20 status = {}
86822024-12-18T22:23:44.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86832024-12-18T22:23:44.108ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "db93a437-3794-4def-902e-e7031c4cbd13", "content-length": "691", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86842024-12-18T22:23:44.108ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86852024-12-18T22:23:44.108ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86862024-12-18T22:23:44.108ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86872024-12-18T22:23:44.110ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.923499ms iteration = 20 status = {}
86882024-12-18T22:23:44.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86892024-12-18T22:23:44.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86902024-12-18T22:23:44.145ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
86912024-12-18T22:23:44.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86922024-12-18T22:23:44.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86932024-12-18T22:23:44.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86942024-12-18T22:23:44.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "73be24d7-b1d9-40a4-903d-1ea99ce37ff9", "content-length": "134", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
86952024-12-18T22:23:44.154ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86962024-12-18T22:23:44.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
86972024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86982024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86992024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87002024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87012024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87022024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87032024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87042024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87052024-12-18T22:23:44.155ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
87062024-12-18T22:23:44.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87072024-12-18T22:23:44.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87082024-12-18T22:23:44.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87092024-12-18T22:23:44.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7112b407-b6ea-42a8-9386-bd2c3c4232ed", "content-length": "2", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
87102024-12-18T22:23:44.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87112024-12-18T22:23:44.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b99b3768-563e-4338-b8d3-c52d1d38829b", "content-length": "52", "date": "Wed, 18 Dec 2024 22:23:43 GMT"} })
87122024-12-18T22:23:44.158ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
87132024-12-18T22:23:44.158ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87142024-12-18T22:23:44.253ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "812a993e-c314-4509-86ed-3c05da7a1bd8", "date": "Wed, 18 Dec 2024 22:23:44 GMT"} })
87152024-12-18T22:23:44.253ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
87162024-12-18T22:23:44.253ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87172024-12-18T22:23:44.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4ffc6c3-e71a-4ceb-b287-6321ac34d70c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87182024-12-18T22:23:44.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4ffc6c3-e71a-4ceb-b287-6321ac34d70c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87192024-12-18T22:23:44.253ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "284f354e-5e37-48ff-b85b-3084ff0e5d44", "content-length": "682", "date": "Wed, 18 Dec 2024 22:23:44 GMT"} })
87202024-12-18T22:23:44.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87212024-12-18T22:23:44.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87222024-12-18T22:23:44.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c4ffc6c3-e71a-4ceb-b287-6321ac34d70c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87232024-12-18T22:23:44.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87242024-12-18T22:23:44.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87252024-12-18T22:23:44.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87262024-12-18T22:23:44.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87272024-12-18T22:23:44.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87282024-12-18T22:23:44.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87292024-12-18T22:23:44.269ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 473.321286ms iteration = 20 status = {}
87302024-12-18T22:23:45.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcc2953f-c3f1-4a09-98e0-7a5291de53a0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87312024-12-18T22:23:45.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcc2953f-c3f1-4a09-98e0-7a5291de53a0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87322024-12-18T22:23:45.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcc2953f-c3f1-4a09-98e0-7a5291de53a0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87332024-12-18T22:23:46.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c1f74c9-43bc-416b-970c-fddb9569e7fa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87342024-12-18T22:23:46.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c1f74c9-43bc-416b-970c-fddb9569e7fa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87352024-12-18T22:23:46.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c1f74c9-43bc-416b-970c-fddb9569e7fa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87362024-12-18T22:23:46.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 1a5caf64-d4b6-4b36-8763-c65fce6beb9c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
87372024-12-18T22:23:47.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 354f3320-abb1-4178-8605-f86297ac3a22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87382024-12-18T22:23:47.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 354f3320-abb1-4178-8605-f86297ac3a22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87392024-12-18T22:23:47.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 354f3320-abb1-4178-8605-f86297ac3a22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87402024-12-18T22:23:48.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e6094ff-12aa-4c3a-961e-2b136a42d15f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87412024-12-18T22:23:48.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e6094ff-12aa-4c3a-961e-2b136a42d15f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87422024-12-18T22:23:48.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3e6094ff-12aa-4c3a-961e-2b136a42d15f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87432024-12-18T22:23:49.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12e0ba06-355c-45b2-8bcf-09659401a03c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87442024-12-18T22:23:49.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12e0ba06-355c-45b2-8bcf-09659401a03c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87452024-12-18T22:23:49.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12e0ba06-355c-45b2-8bcf-09659401a03c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87462024-12-18T22:23:50.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f56b0b5-b81b-48c2-a456-a6a949dc2a57 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87472024-12-18T22:23:50.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f56b0b5-b81b-48c2-a456-a6a949dc2a57 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87482024-12-18T22:23:50.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f56b0b5-b81b-48c2-a456-a6a949dc2a57 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87492024-12-18T22:23:51.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d7a5ee3-3425-4bc6-a3a7-d9fec90a0b75 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87502024-12-18T22:23:51.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d7a5ee3-3425-4bc6-a3a7-d9fec90a0b75 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87512024-12-18T22:23:51.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d7a5ee3-3425-4bc6-a3a7-d9fec90a0b75 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87522024-12-18T22:23:52.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 747d186c-c531-4386-bf79-c9580d0abc0f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87532024-12-18T22:23:52.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 747d186c-c531-4386-bf79-c9580d0abc0f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87542024-12-18T22:23:52.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 747d186c-c531-4386-bf79-c9580d0abc0f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87552024-12-18T22:23:53.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71eb2722-3acc-4d09-8946-48cbeee1a86c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87562024-12-18T22:23:53.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71eb2722-3acc-4d09-8946-48cbeee1a86c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87572024-12-18T22:23:53.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71eb2722-3acc-4d09-8946-48cbeee1a86c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87582024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
87592024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
87602024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87612024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87622024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87632024-12-18T22:23:53.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87642024-12-18T22:23:53.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87652024-12-18T22:23:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87662024-12-18T22:23:53.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87672024-12-18T22:23:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87682024-12-18T22:23:53.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87692024-12-18T22:23:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87702024-12-18T22:23:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87712024-12-18T22:23:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87722024-12-18T22:23:53.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.1403ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87732024-12-18T22:23:53.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87742024-12-18T22:23:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
87752024-12-18T22:23:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87762024-12-18T22:23:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87772024-12-18T22:23:53.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
87782024-12-18T22:23:53.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.295178ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
87792024-12-18T22:23:54.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87050ac5-8531-435f-b580-bb73a8b80e56 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87802024-12-18T22:23:54.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87050ac5-8531-435f-b580-bb73a8b80e56 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87812024-12-18T22:23:54.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 87050ac5-8531-435f-b580-bb73a8b80e56 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87822024-12-18T22:23:55.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e98f54c5-82ed-4b1a-8107-52251651d69c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87832024-12-18T22:23:55.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e98f54c5-82ed-4b1a-8107-52251651d69c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87842024-12-18T22:23:55.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e98f54c5-82ed-4b1a-8107-52251651d69c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87852024-12-18T22:23:56.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 672af4af-0a31-48e5-9f96-885ded5ad1e9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87862024-12-18T22:23:56.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 672af4af-0a31-48e5-9f96-885ded5ad1e9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87872024-12-18T22:23:56.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 672af4af-0a31-48e5-9f96-885ded5ad1e9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87882024-12-18T22:23:56.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = f414bc15-7e68-4271-9572-3d8000163ca4 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
87892024-12-18T22:23:57.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd4eb81c-9d58-4243-ba01-18ec2b07d1d1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87902024-12-18T22:23:57.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd4eb81c-9d58-4243-ba01-18ec2b07d1d1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87912024-12-18T22:23:57.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fd4eb81c-9d58-4243-ba01-18ec2b07d1d1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87922024-12-18T22:23:58.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7e3904-d8a2-4f82-b165-7be5905b3c95 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87932024-12-18T22:23:58.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7e3904-d8a2-4f82-b165-7be5905b3c95 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87942024-12-18T22:23:58.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a7e3904-d8a2-4f82-b165-7be5905b3c95 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87952024-12-18T22:23:59.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81ccda1c-29fb-4301-a7cd-ef25b0dc3995 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87962024-12-18T22:23:59.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81ccda1c-29fb-4301-a7cd-ef25b0dc3995 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87972024-12-18T22:23:59.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81ccda1c-29fb-4301-a7cd-ef25b0dc3995 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87982024-12-18T22:24:00.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d132900-c215-44aa-aaf9-50860f3db63c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
87992024-12-18T22:24:00.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d132900-c215-44aa-aaf9-50860f3db63c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88002024-12-18T22:24:00.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0d132900-c215-44aa-aaf9-50860f3db63c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88012024-12-18T22:24:01.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d6b7d95-783c-4f19-8581-b92a1b701d43 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88022024-12-18T22:24:01.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d6b7d95-783c-4f19-8581-b92a1b701d43 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88032024-12-18T22:24:01.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d6b7d95-783c-4f19-8581-b92a1b701d43 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88042024-12-18T22:24:02.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0415d796-ea4d-4fd1-a512-c8d6df6c0bea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88052024-12-18T22:24:02.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0415d796-ea4d-4fd1-a512-c8d6df6c0bea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88062024-12-18T22:24:02.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0415d796-ea4d-4fd1-a512-c8d6df6c0bea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88072024-12-18T22:24:03.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fac32a84-a209-44ce-9bac-a9c44f7b697e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88082024-12-18T22:24:03.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fac32a84-a209-44ce-9bac-a9c44f7b697e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88092024-12-18T22:24:03.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fac32a84-a209-44ce-9bac-a9c44f7b697e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88102024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
88112024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
88122024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88132024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88142024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88152024-12-18T22:24:03.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88162024-12-18T22:24:03.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172024-12-18T22:24:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88182024-12-18T22:24:03.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88192024-12-18T22:24:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88202024-12-18T22:24:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88212024-12-18T22:24:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88222024-12-18T22:24:03.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88232024-12-18T22:24:03.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
88242024-12-18T22:24:03.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88252024-12-18T22:24:03.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88262024-12-18T22:24:03.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
88272024-12-18T22:24:03.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.171796ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
88282024-12-18T22:24:03.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88292024-12-18T22:24:03.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88302024-12-18T22:24:03.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.504499ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88312024-12-18T22:24:04.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d1f79f-a3a3-4ba5-bb35-05ed614b059a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88322024-12-18T22:24:04.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d1f79f-a3a3-4ba5-bb35-05ed614b059a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88332024-12-18T22:24:04.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d1f79f-a3a3-4ba5-bb35-05ed614b059a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88342024-12-18T22:24:05.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d65285-136a-4238-bf93-cbf9fe9c77c8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88352024-12-18T22:24:05.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d65285-136a-4238-bf93-cbf9fe9c77c8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88362024-12-18T22:24:05.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 83d65285-136a-4238-bf93-cbf9fe9c77c8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88372024-12-18T22:24:06.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = c98df7ee-2127-468d-ab15-972d7d54eb9e response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
88382024-12-18T22:24:06.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a14e68f-0ca2-4c59-8634-8f2341eb5d53 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88392024-12-18T22:24:06.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a14e68f-0ca2-4c59-8634-8f2341eb5d53 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88402024-12-18T22:24:06.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6a14e68f-0ca2-4c59-8634-8f2341eb5d53 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88412024-12-18T22:24:07.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c78ed0a2-c375-4cef-ae6a-5f0193cd4c03 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88422024-12-18T22:24:07.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c78ed0a2-c375-4cef-ae6a-5f0193cd4c03 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88432024-12-18T22:24:07.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c78ed0a2-c375-4cef-ae6a-5f0193cd4c03 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88442024-12-18T22:24:08.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71b75e59-ef56-44b6-b750-cbef24dc6b27 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88452024-12-18T22:24:08.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71b75e59-ef56-44b6-b750-cbef24dc6b27 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88462024-12-18T22:24:08.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71b75e59-ef56-44b6-b750-cbef24dc6b27 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88472024-12-18T22:24:09.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a8a85c3-36f5-4459-8461-46a9b8092679 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88482024-12-18T22:24:09.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a8a85c3-36f5-4459-8461-46a9b8092679 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88492024-12-18T22:24:09.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7a8a85c3-36f5-4459-8461-46a9b8092679 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88502024-12-18T22:24:10.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6806572e-bfbd-488c-aea9-d7e41d2b5068 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88512024-12-18T22:24:10.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6806572e-bfbd-488c-aea9-d7e41d2b5068 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88522024-12-18T22:24:10.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6806572e-bfbd-488c-aea9-d7e41d2b5068 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88532024-12-18T22:24:11.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90900d59-c4e3-4f0d-b669-a96b88f2c36a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88542024-12-18T22:24:11.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90900d59-c4e3-4f0d-b669-a96b88f2c36a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88552024-12-18T22:24:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90900d59-c4e3-4f0d-b669-a96b88f2c36a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88562024-12-18T22:24:12.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9c7b93c-f8de-4c5a-ac84-b2595e1faf6e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88572024-12-18T22:24:12.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9c7b93c-f8de-4c5a-ac84-b2595e1faf6e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88582024-12-18T22:24:12.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f9c7b93c-f8de-4c5a-ac84-b2595e1faf6e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
88592024-12-18T22:24:13.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d15019c8-8ef7-44fe-89ba-926e78571412 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88602024-12-18T22:24:13.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d15019c8-8ef7-44fe-89ba-926e78571412 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88612024-12-18T22:24:13.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d15019c8-8ef7-44fe-89ba-926e78571412 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
88622024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
88632024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
88642024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88652024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88662024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
88672024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88682024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
88692024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
88702024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88712024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88722024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
88732024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
88742024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88752024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
88762024-12-18T22:24:13.796ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
88772024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
88782024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.32\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
88792024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88802024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
88812024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
88822024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
88832024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88842024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88852024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
88862024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88872024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88882024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
88892024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
88902024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
88912024-12-18T22:24:13.796ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
88922024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88932024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
88942024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88952024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
88962024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88972024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
88982024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
88992024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89002024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89012024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89022024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
89032024-12-18T22:24:13.796ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
89042024-12-18T22:24:13.796ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
89052024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
89062024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89072024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89082024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
89092024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
89102024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89112024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89122024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
89132024-12-18T22:24:13.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89142024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
89152024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89162024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89172024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
89182024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
89192024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89202024-12-18T22:24:13.796ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
89212024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89222024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
89232024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89242024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89252024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
89262024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
89272024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
89282024-12-18T22:24:13.796ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:14:13.796826539 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89292024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89302024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
89312024-12-18T22:24:13.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89322024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89332024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89342024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89352024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89362024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89372024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89382024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89392024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89402024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89412024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89422024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89432024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89442024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89452024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89462024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89472024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89482024-12-18T22:24:13.797ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
89492024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89502024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89512024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89522024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89532024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89542024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89552024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89562024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89572024-12-18T22:24:13.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 415963011 } })
89582024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89592024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89602024-12-18T22:24:13.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 416063483 } })
89612024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89622024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.110012ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89632024-12-18T22:24:13.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
89642024-12-18T22:24:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.440449ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
89652024-12-18T22:24:13.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89662024-12-18T22:24:13.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.189672ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89672024-12-18T22:24:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89682024-12-18T22:24:13.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89692024-12-18T22:24:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89702024-12-18T22:24:13.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89712024-12-18T22:24:13.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89722024-12-18T22:24:13.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89732024-12-18T22:24:13.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89742024-12-18T22:24:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89752024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89762024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89772024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89782024-12-18T22:24:13.808ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89792024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.174149ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89802024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89812024-12-18T22:24:13.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89822024-12-18T22:24:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89832024-12-18T22:24:13.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89842024-12-18T22:24:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89852024-12-18T22:24:13.814ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89862024-12-18T22:24:13.814ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89872024-12-18T22:24:13.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89882024-12-18T22:24:13.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89892024-12-18T22:24:13.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89902024-12-18T22:24:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89912024-12-18T22:24:13.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89922024-12-18T22:24:13.816ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:14:13.796826539 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89932024-12-18T22:24:13.816ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.810998ms iteration = 11 status = {"expiration":"2024-12-18T22:14:13.796826539Z","pruned":[]}
89942024-12-18T22:24:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89952024-12-18T22:24:13.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89962024-12-18T22:24:13.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89972024-12-18T22:24:13.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 439412191 } })
89982024-12-18T22:24:13.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 439681556 } })
89992024-12-18T22:24:13.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
90002024-12-18T22:24:13.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
90012024-12-18T22:24:13.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90022024-12-18T22:24:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90032024-12-18T22:24:13.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90042024-12-18T22:24:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90052024-12-18T22:24:13.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90062024-12-18T22:24:13.824ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.398838ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
90072024-12-18T22:24:13.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90082024-12-18T22:24:13.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90092024-12-18T22:24:13.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90102024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90112024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90122024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90132024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90142024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90152024-12-18T22:24:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90162024-12-18T22:24:13.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90172024-12-18T22:24:13.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90182024-12-18T22:24:13.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 449952678 } })
90192024-12-18T22:24:13.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
90202024-12-18T22:24:13.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90212024-12-18T22:24:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90222024-12-18T22:24:13.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90232024-12-18T22:24:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90242024-12-18T22:24:13.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90252024-12-18T22:24:13.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90262024-12-18T22:24:13.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90272024-12-18T22:24:13.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90282024-12-18T22:24:13.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90292024-12-18T22:24:13.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90302024-12-18T22:24:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90312024-12-18T22:24:13.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90322024-12-18T22:24:13.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.123027ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
90332024-12-18T22:24:13.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90342024-12-18T22:24:13.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90352024-12-18T22:24:13.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90362024-12-18T22:24:13.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372024-12-18T22:24:13.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90382024-12-18T22:24:13.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90392024-12-18T22:24:13.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90402024-12-18T22:24:13.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90412024-12-18T22:24:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90422024-12-18T22:24:13.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90432024-12-18T22:24:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90442024-12-18T22:24:13.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90452024-12-18T22:24:13.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90462024-12-18T22:24:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90472024-12-18T22:24:13.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
90482024-12-18T22:24:13.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90492024-12-18T22:24:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90502024-12-18T22:24:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90512024-12-18T22:24:13.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90522024-12-18T22:24:13.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90532024-12-18T22:24:13.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90542024-12-18T22:24:13.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90552024-12-18T22:24:13.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90562024-12-18T22:24:13.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90572024-12-18T22:24:13.859ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.971486ms iteration = 23 status = {"physical_disks_added":0}
90582024-12-18T22:24:13.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.75664ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
90592024-12-18T22:24:13.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90602024-12-18T22:24:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90612024-12-18T22:24:13.864ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622024-12-18T22:24:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
90632024-12-18T22:24:13.866ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90642024-12-18T22:24:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90652024-12-18T22:24:13.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662024-12-18T22:24:13.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90672024-12-18T22:24:13.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.055942ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90682024-12-18T22:24:13.873ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90692024-12-18T22:24:13.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90702024-12-18T22:24:13.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90712024-12-18T22:24:13.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90722024-12-18T22:24:13.875ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90732024-12-18T22:24:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90742024-12-18T22:24:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90752024-12-18T22:24:13.877ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90762024-12-18T22:24:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90772024-12-18T22:24:13.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90782024-12-18T22:24:13.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90792024-12-18T22:24:13.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90802024-12-18T22:24:13.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90812024-12-18T22:24:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90822024-12-18T22:24:13.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.939956ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90832024-12-18T22:24:13.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.374723ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90842024-12-18T22:24:13.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90852024-12-18T22:24:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90862024-12-18T22:24:13.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90872024-12-18T22:24:13.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90882024-12-18T22:24:13.908ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
90892024-12-18T22:24:13.908ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
90902024-12-18T22:24:13.908ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
90912024-12-18T22:24:13.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90922024-12-18T22:24:13.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90932024-12-18T22:24:13.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90cd48a5-9b57-46d9-85c3-1697e292292a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
90942024-12-18T22:24:13.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90cd48a5-9b57-46d9-85c3-1697e292292a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
90952024-12-18T22:24:13.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90962024-12-18T22:24:13.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90972024-12-18T22:24:13.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90982024-12-18T22:24:13.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90992024-12-18T22:24:13.963ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
91002024-12-18T22:24:13.963ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 166.599128ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
91012024-12-18T22:24:13.970ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91022024-12-18T22:24:13.970ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91032024-12-18T22:24:13.970ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eac01f14-25e0-414c-86de-3feb9f7f1859", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
91042024-12-18T22:24:13.970ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91052024-12-18T22:24:13.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91062024-12-18T22:24:13.991ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91072024-12-18T22:24:13.991ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91082024-12-18T22:24:13.991ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5f3ca6-194b-4604-a57c-483370957c1a", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
91092024-12-18T22:24:13.991ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91102024-12-18T22:24:13.993ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91112024-12-18T22:24:14.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
91122024-12-18T22:24:14.011ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91132024-12-18T22:24:14.011ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62646891-9c6e-4b8f-bf03-1c35ab6377ee", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
91142024-12-18T22:24:14.011ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91152024-12-18T22:24:14.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
91162024-12-18T22:24:14.075ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91172024-12-18T22:24:14.077ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91182024-12-18T22:24:14.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91192024-12-18T22:24:14.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "da19b422-ab95-4bfa-8703-c40e7d37d073", "content-length": "372", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
91202024-12-18T22:24:14.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91212024-12-18T22:24:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91222024-12-18T22:24:14.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 282.87476ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91232024-12-18T22:24:14.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91242024-12-18T22:24:14.083ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(d571f265-fd63-4718-9fc1-e0201f644725, 0), (e2958f0c-63f5-40ba-b9b3-907b61bc30bd, 0), (01a45b05-0d95-4440-af3d-da7b8405a8f0, 0), (4729f437-abdc-4cc3-8df8-587ec3eee3db, 0)] collection_id = d571f265-fd63-4718-9fc1-e0201f644725
91252024-12-18T22:24:14.083ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91262024-12-18T22:24:14.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272024-12-18T22:24:14.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91282024-12-18T22:24:14.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90cd48a5-9b57-46d9-85c3-1697e292292a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
91292024-12-18T22:24:14.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91302024-12-18T22:24:14.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91312024-12-18T22:24:14.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91322024-12-18T22:24:14.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91332024-12-18T22:24:14.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91342024-12-18T22:24:14.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91352024-12-18T22:24:14.102ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
91362024-12-18T22:24:14.102ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 306.419162ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
91372024-12-18T22:24:14.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91382024-12-18T22:24:14.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91392024-12-18T22:24:14.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91402024-12-18T22:24:14.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91412024-12-18T22:24:14.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91422024-12-18T22:24:14.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91432024-12-18T22:24:14.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91442024-12-18T22:24:14.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
91452024-12-18T22:24:14.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91462024-12-18T22:24:14.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91472024-12-18T22:24:14.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91482024-12-18T22:24:14.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91492024-12-18T22:24:14.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91502024-12-18T22:24:14.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91512024-12-18T22:24:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91522024-12-18T22:24:14.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91532024-12-18T22:24:14.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91542024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91552024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91562024-12-18T22:24:14.120ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91572024-12-18T22:24:14.120ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91582024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 323.67095ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91592024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 323.866644ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
91602024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91612024-12-18T22:24:14.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91622024-12-18T22:24:14.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91632024-12-18T22:24:14.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91642024-12-18T22:24:14.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91652024-12-18T22:24:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91662024-12-18T22:24:14.124ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
91672024-12-18T22:24:14.124ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "936f0eb3-c9d0-44c7-b552-7f9194db9729", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91682024-12-18T22:24:14.124ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91692024-12-18T22:24:14.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
91702024-12-18T22:24:14.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91712024-12-18T22:24:14.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91722024-12-18T22:24:14.126ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91732024-12-18T22:24:14.126ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91742024-12-18T22:24:14.126ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 329.396293ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91752024-12-18T22:24:14.126ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ec8038bd-3fd4-44c5-a2d6-7ba5187bb966", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91762024-12-18T22:24:14.126ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91772024-12-18T22:24:14.127ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91782024-12-18T22:24:14.127ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91792024-12-18T22:24:14.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91802024-12-18T22:24:14.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91812024-12-18T22:24:14.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91822024-12-18T22:24:14.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91832024-12-18T22:24:14.128ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91842024-12-18T22:24:14.128ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.31496ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
91852024-12-18T22:24:14.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91862024-12-18T22:24:14.130ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.303179ms iteration = 21 status = {}
91872024-12-18T22:24:14.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91882024-12-18T22:24:14.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91892024-12-18T22:24:14.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91902024-12-18T22:24:14.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91912024-12-18T22:24:14.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91922024-12-18T22:24:14.135ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91932024-12-18T22:24:14.135ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
91942024-12-18T22:24:14.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91952024-12-18T22:24:14.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91962024-12-18T22:24:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91972024-12-18T22:24:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91982024-12-18T22:24:14.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-12-18T22:24:14.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92002024-12-18T22:24:14.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92012024-12-18T22:24:14.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92022024-12-18T22:24:14.139ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
92032024-12-18T22:24:14.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92042024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92052024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92062024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "78a8258d-845e-4275-9cb5-37ac10eff8bb", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
92072024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92082024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92092024-12-18T22:24:14.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92102024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
92112024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92122024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
92132024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 345.281254ms iteration = 11 status = {"generation":2}
92142024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
92152024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92162024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92172024-12-18T22:24:14.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92182024-12-18T22:24:14.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92192024-12-18T22:24:14.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92202024-12-18T22:24:14.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92212024-12-18T22:24:14.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92222024-12-18T22:24:14.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92232024-12-18T22:24:14.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92242024-12-18T22:24:14.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92252024-12-18T22:24:14.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92262024-12-18T22:24:14.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92272024-12-18T22:24:14.149ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92282024-12-18T22:24:14.149ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = d571f265-fd63-4718-9fc1-e0201f644725 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
92292024-12-18T22:24:14.149ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92302024-12-18T22:24:14.149ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92312024-12-18T22:24:14.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92322024-12-18T22:24:14.149ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cad276ab-8d92-4f22-a476-ec22e48da40b", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
92332024-12-18T22:24:14.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92342024-12-18T22:24:14.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92352024-12-18T22:24:14.150ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 354.18319ms iteration = 21 status = {}
92362024-12-18T22:24:14.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92372024-12-18T22:24:14.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92382024-12-18T22:24:14.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92392024-12-18T22:24:14.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92402024-12-18T22:24:14.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92412024-12-18T22:24:14.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92422024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
92432024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92442024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92452024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92462024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92472024-12-18T22:24:14.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92482024-12-18T22:24:14.155ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(e2958f0c-63f5-40ba-b9b3-907b61bc30bd, 0), (01a45b05-0d95-4440-af3d-da7b8405a8f0, 0), (4729f437-abdc-4cc3-8df8-587ec3eee3db, 0), (7a656aac-a0f6-4f7b-a2c4-8c07ade561a7, 0)] collection_id = e2958f0c-63f5-40ba-b9b3-907b61bc30bd
92492024-12-18T22:24:14.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92502024-12-18T22:24:14.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92512024-12-18T22:24:14.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92522024-12-18T22:24:14.156ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 359.83679ms iteration = 21 status = 0
92532024-12-18T22:24:14.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92542024-12-18T22:24:14.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92552024-12-18T22:24:14.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92562024-12-18T22:24:14.161ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92572024-12-18T22:24:14.161ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92582024-12-18T22:24:14.161ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
92592024-12-18T22:24:14.161ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 364.42406ms iteration = 11 status = {"generation":1}
92602024-12-18T22:24:14.163ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92612024-12-18T22:24:14.163ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "181506b8-a6e4-4af4-afa7-ecfa48e76447", "content-length": "1", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
92622024-12-18T22:24:14.165ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92632024-12-18T22:24:14.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92642024-12-18T22:24:14.167ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.923358ms iteration = 21 status = null
92652024-12-18T22:24:14.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92662024-12-18T22:24:14.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
92672024-12-18T22:24:14.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92682024-12-18T22:24:14.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92692024-12-18T22:24:14.186ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92702024-12-18T22:24:14.187ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9a66f737-174e-4a1d-9087-88050eb3faf5", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92712024-12-18T22:24:14.187ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92722024-12-18T22:24:14.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92732024-12-18T22:24:14.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92742024-12-18T22:24:14.188ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0ff12a76-b0ad-497d-aa7e-cdd9a29af36f", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92752024-12-18T22:24:14.188ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92762024-12-18T22:24:14.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92772024-12-18T22:24:14.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92782024-12-18T22:24:14.190ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "177c095b-1529-4c49-8228-3f78d71d0e82", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92792024-12-18T22:24:14.190ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92802024-12-18T22:24:14.194ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
92812024-12-18T22:24:14.194ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 397.634702ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
92822024-12-18T22:24:14.195ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
92832024-12-18T22:24:14.195ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 398.734184ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92842024-12-18T22:24:14.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92852024-12-18T22:24:14.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
92862024-12-18T22:24:14.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92872024-12-18T22:24:14.199ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
92882024-12-18T22:24:14.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92892024-12-18T22:24:14.199ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 402.606709ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92902024-12-18T22:24:14.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92912024-12-18T22:24:14.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92922024-12-18T22:24:14.226ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = e2958f0c-63f5-40ba-b9b3-907b61bc30bd file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
92932024-12-18T22:24:14.226ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
92942024-12-18T22:24:14.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
92952024-12-18T22:24:14.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92962024-12-18T22:24:14.244ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61fb47b8-c881-4384-8d4e-416070b33a3a", "content-length": "691", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
92972024-12-18T22:24:14.244ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92982024-12-18T22:24:14.244ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92992024-12-18T22:24:14.244ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93002024-12-18T22:24:14.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93012024-12-18T22:24:14.245ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 449.254515ms iteration = 21 status = {}
93022024-12-18T22:24:14.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93032024-12-18T22:24:14.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93042024-12-18T22:24:14.247ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(01a45b05-0d95-4440-af3d-da7b8405a8f0, 0), (4729f437-abdc-4cc3-8df8-587ec3eee3db, 0), (7a656aac-a0f6-4f7b-a2c4-8c07ade561a7, 0)]
93052024-12-18T22:24:14.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93062024-12-18T22:24:14.248ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 866681264 } })
93072024-12-18T22:24:14.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93082024-12-18T22:24:14.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93092024-12-18T22:24:14.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93102024-12-18T22:24:14.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93112024-12-18T22:24:14.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93122024-12-18T22:24:14.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93132024-12-18T22:24:14.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93142024-12-18T22:24:14.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93152024-12-18T22:24:14.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93162024-12-18T22:24:14.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
93172024-12-18T22:24:14.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93182024-12-18T22:24:14.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93192024-12-18T22:24:14.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93202024-12-18T22:24:14.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93212024-12-18T22:24:14.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93222024-12-18T22:24:14.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93232024-12-18T22:24:14.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93242024-12-18T22:24:14.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
93252024-12-18T22:24:14.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93262024-12-18T22:24:14.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93272024-12-18T22:24:14.279ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
93282024-12-18T22:24:14.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93292024-12-18T22:24:14.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93302024-12-18T22:24:14.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93312024-12-18T22:24:14.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
93322024-12-18T22:24:14.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93332024-12-18T22:24:14.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93342024-12-18T22:24:14.284ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
93352024-12-18T22:24:14.284ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 104d2c5b-1a03-416e-83a1-9840a7797640, kind: Service { id: d0ef80fe-5a3c-4585-be47-819c465c7a37 }, name: Name("external-dns-d0ef80fe-5a3c-4585-be47-819c465c7a37"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 607e1df6-370f-4c69-a01b-1dec075c60ae, kind: Service { id: 160de9b3-61fd-47fd-9883-78dcc7b014f0 }, name: Name("external-dns-160de9b3-61fd-47fd-9883-78dcc7b014f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 76])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0bab2332-a525-46aa-9d7e-fb4af64f3c88, kind: Service { id: 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395 }, name: Name("nexus-9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 86])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af14a7c6-4009-42e7-b00a-57c5ae0399bb, kind: Service { id: 175d3cc8-9a02-4cf3-970c-8ec76a875436 }, name: Name("nexus-175d3cc8-9a02-4cf3-970c-8ec76a875436"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 206])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d048e606-7b77-4cdc-951d-7050040ab8d1, kind: Service { id: c0e3d114-075e-41a4-a4df-fa8131bbea97 }, name: Name("nexus-c0e3d114-075e-41a4-a4df-fa8131bbea97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 145])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
93362024-12-18T22:24:14.284ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
93372024-12-18T22:24:14.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93382024-12-18T22:24:14.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93392024-12-18T22:24:14.288ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
93402024-12-18T22:24:14.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93412024-12-18T22:24:14.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93422024-12-18T22:24:14.300ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93432024-12-18T22:24:14.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8ea5975-3163-455e-9c9b-ebd2f9b0386a", "content-length": "134", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93442024-12-18T22:24:14.300ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93452024-12-18T22:24:14.300ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
93462024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93472024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93482024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93492024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93502024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93512024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93522024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93532024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93542024-12-18T22:24:14.301ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
93552024-12-18T22:24:14.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93562024-12-18T22:24:14.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93572024-12-18T22:24:14.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93582024-12-18T22:24:14.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f460f85-7105-4ad6-bfc5-06b89c159a5c", "content-length": "2", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93592024-12-18T22:24:14.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93602024-12-18T22:24:14.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "829d315f-a391-4735-90bd-265bfcd721f7", "content-length": "52", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93612024-12-18T22:24:14.304ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
93622024-12-18T22:24:14.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93632024-12-18T22:24:14.305ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
93642024-12-18T22:24:14.305ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
93652024-12-18T22:24:14.305ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
93662024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "baac15ec-b6f9-4a8b-96dd-e193c3ee5683", "content-length": "476", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93672024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
93682024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8c8b5bb-7748-4bf3-aa38-9609e3242713", "content-length": "734", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93692024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
93702024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "06ce1d28-066b-4ee3-801d-6eb8a00b6317", "content-length": "111", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93712024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
93722024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d17ed829-49da-4d1b-b33f-48da3a1361fb", "content-length": "111", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93732024-12-18T22:24:14.306ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
93742024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aebb26c-a83a-4a4b-94f6-78936f97cc6b", "content-length": "167", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93752024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
93762024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3fe06e-6b5c-4801-91da-91a66bbecc53", "content-length": "167", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93772024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
93782024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "71012b11-f4bd-42eb-bc73-8c8110ebcec9", "content-length": "175", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93792024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
93802024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "92b48de2-640c-465d-9aa4-816c2ce33603", "content-length": "175", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93812024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
93822024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3d3552e-668c-40b1-a566-d9644d81dd49", "content-length": "702", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93832024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93842024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "58c24c9e-8bdc-48c8-bffe-ad6e9b2eb706", "content-length": "727", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93852024-12-18T22:24:14.307ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93862024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "119bc779-9588-4ddf-9b9a-00f549fc5f24", "content-length": "729", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} })
93872024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93882024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "818b741a-ddf8-4924-b15d-b3ba02e3b10d", "content-length": "728", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93892024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
93902024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc52ff1-11d2-4a19-a9d3-9383f55f83dc", "content-length": "722", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93912024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
93922024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "06cd144e-0bde-4ef2-9c58-f90c0cf1dba0", "content-length": "109", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93932024-12-18T22:24:14.308ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
93942024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3977c6e-cdac-4b43-8e63-91d3ff29b21b", "content-length": "109", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93952024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
93962024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95023d76-70c6-4f41-9c63-5fbcafbd32b1", "content-length": "169", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93972024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
93982024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7b6ecd-2ef5-4775-a3c7-9e6f2e33d24f", "content-length": "169", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
93992024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
94002024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a1a32a9-49c1-4df2-8ccb-cd6db684fe65", "content-length": "178", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94012024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
94022024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae2db4ce-40b6-4960-b00c-c3b155612dc7", "content-length": "178", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94032024-12-18T22:24:14.309ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
94042024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b49ecc7-523c-45c5-9e45-efbeddc6aece", "content-length": "702", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94052024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94062024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3352808f-ae95-494a-9de2-0ef4f4247e85", "content-length": "727", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94072024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94082024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56c2879a-d16c-4ed2-91b4-975c9e10647b", "content-length": "729", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94092024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94102024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b52c4911-a850-486d-9862-daec80c67709", "content-length": "728", "date": "Wed, 18 Dec 2024 22:24:13 GMT"} })
94112024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94122024-12-18T22:24:14.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94132024-12-18T22:24:14.312ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94142024-12-18T22:24:14.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94152024-12-18T22:24:14.313ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94162024-12-18T22:24:14.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94172024-12-18T22:24:14.315ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94182024-12-18T22:24:14.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94192024-12-18T22:24:14.317ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94202024-12-18T22:24:14.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94212024-12-18T22:24:14.390ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, time_created: 2024-12-18T22:14:41.637384Z, time_modified: 2024-12-18T22:14:41.637384Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
94222024-12-18T22:24:14.390ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
94232024-12-18T22:24:14.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94242024-12-18T22:24:14.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94252024-12-18T22:24:14.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
94262024-12-18T22:24:14.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
94272024-12-18T22:24:14.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94282024-12-18T22:24:14.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
94292024-12-18T22:24:14.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2549f09b-0c54-460e-a206-da11c9aa5f02", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} })
94302024-12-18T22:24:14.401ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
94312024-12-18T22:24:14.401ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94322024-12-18T22:24:14.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "32977298-aa62-42d0-9631-7bca4ff5c809", "content-length": "682", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} })
94332024-12-18T22:24:14.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94342024-12-18T22:24:14.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94352024-12-18T22:24:14.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94362024-12-18T22:24:14.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94372024-12-18T22:24:14.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94382024-12-18T22:24:14.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94392024-12-18T22:24:14.416ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
94402024-12-18T22:24:14.416ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
94412024-12-18T22:24:14.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94422024-12-18T22:24:14.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94432024-12-18T22:24:14.426ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 629.603153ms iteration = 21 status = {}
94442024-12-18T22:24:14.438ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
94452024-12-18T22:24:14.439ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "7a170015-8cab-4070-866b-a2184fe3e988", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} })
94462024-12-18T22:24:14.441ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
94472024-12-18T22:24:14.441ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 644.941324ms
94482024-12-18T22:24:14.441ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 644.951604ms iteration = 3 status = {}
94492024-12-18T22:24:14.613ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "72caa426-6c45-46eb-81b8-74be680a4bce", "content-length": "30799", "date": "Wed, 18 Dec 2024 22:24:14 GMT"} })
94502024-12-18T22:24:14.614ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94512024-12-18T22:24:14.614ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94522024-12-18T22:24:14.614ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
94532024-12-18T22:24:14.616ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94542024-12-18T22:24:14.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94552024-12-18T22:24:14.617ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94562024-12-18T22:24:14.619ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
94572024-12-18T22:24:14.619ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94582024-12-18T22:24:14.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94592024-12-18T22:24:14.784ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 9420d668-569d-47d5-81e9-5c25b64b3448 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
94602024-12-18T22:24:14.784ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 9420d668-569d-47d5-81e9-5c25b64b3448 time_started = 2024-12-18 22:24:14.305768 UTC
94612024-12-18T22:24:14.784ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 988.098536ms iteration = 3 status = {"collection_id":"9420d668-569d-47d5-81e9-5c25b64b3448","time_done":"2024-12-18 22:24:14.614805 UTC","time_started":"2024-12-18 22:24:14.305768 UTC"}
94622024-12-18T22:24:14.784ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
94632024-12-18T22:24:14.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94642024-12-18T22:24:14.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94652024-12-18T22:24:14.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94662024-12-18T22:24:14.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94672024-12-18T22:24:14.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94682024-12-18T22:24:14.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94692024-12-18T22:24:14.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94702024-12-18T22:24:14.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94712024-12-18T22:24:14.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94722024-12-18T22:24:14.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94732024-12-18T22:24:14.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94742024-12-18T22:24:14.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94752024-12-18T22:24:14.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.311839ms iteration = 24 status = {"physical_disks_added":0}
94762024-12-18T22:24:15.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57c93367-bc3e-4dfe-8071-89ec57347af5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94772024-12-18T22:24:15.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57c93367-bc3e-4dfe-8071-89ec57347af5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94782024-12-18T22:24:15.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 57c93367-bc3e-4dfe-8071-89ec57347af5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94792024-12-18T22:24:16.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b8ef224-39bf-43c1-b63e-f1832f229d25 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94802024-12-18T22:24:16.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b8ef224-39bf-43c1-b63e-f1832f229d25 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94812024-12-18T22:24:16.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2b8ef224-39bf-43c1-b63e-f1832f229d25 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94822024-12-18T22:24:16.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 580 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = bfe32d53-ff23-457f-9bfc-c2ac41b0c0c7 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
94832024-12-18T22:24:17.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 817f769c-5e43-42c3-8797-86e609b7071e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94842024-12-18T22:24:17.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 817f769c-5e43-42c3-8797-86e609b7071e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94852024-12-18T22:24:17.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 817f769c-5e43-42c3-8797-86e609b7071e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94862024-12-18T22:24:18.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f8b04f0-3f43-445f-9388-60161875c549 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94872024-12-18T22:24:18.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f8b04f0-3f43-445f-9388-60161875c549 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94882024-12-18T22:24:18.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4f8b04f0-3f43-445f-9388-60161875c549 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94892024-12-18T22:24:19.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 540ca0d8-af4b-4130-a865-471cf0de9599 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94902024-12-18T22:24:19.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 540ca0d8-af4b-4130-a865-471cf0de9599 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94912024-12-18T22:24:19.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 540ca0d8-af4b-4130-a865-471cf0de9599 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94922024-12-18T22:24:20.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 64023506-9b64-4b8e-9a4a-81aada5c43ed roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94932024-12-18T22:24:20.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 64023506-9b64-4b8e-9a4a-81aada5c43ed resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94942024-12-18T22:24:20.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 64023506-9b64-4b8e-9a4a-81aada5c43ed response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94952024-12-18T22:24:21.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cc1418a-bf89-45f4-b55a-a2c42f64116d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94962024-12-18T22:24:21.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cc1418a-bf89-45f4-b55a-a2c42f64116d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94972024-12-18T22:24:21.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4cc1418a-bf89-45f4-b55a-a2c42f64116d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94982024-12-18T22:24:22.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b62f96-8a45-46ba-9923-531adc84b801 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
94992024-12-18T22:24:22.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b62f96-8a45-46ba-9923-531adc84b801 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95002024-12-18T22:24:22.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b62f96-8a45-46ba-9923-531adc84b801 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95012024-12-18T22:24:23.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73be9f46-2a9b-45c4-9450-2e17c67bb137 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95022024-12-18T22:24:23.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73be9f46-2a9b-45c4-9450-2e17c67bb137 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95032024-12-18T22:24:23.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 73be9f46-2a9b-45c4-9450-2e17c67bb137 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95042024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
95052024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
95062024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95072024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95082024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95092024-12-18T22:24:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95102024-12-18T22:24:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95112024-12-18T22:24:23.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95122024-12-18T22:24:23.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95132024-12-18T22:24:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95142024-12-18T22:24:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95152024-12-18T22:24:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95162024-12-18T22:24:23.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.690392ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95172024-12-18T22:24:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95182024-12-18T22:24:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95192024-12-18T22:24:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95202024-12-18T22:24:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
95212024-12-18T22:24:23.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95222024-12-18T22:24:23.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95232024-12-18T22:24:23.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
95242024-12-18T22:24:23.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.710257ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
95252024-12-18T22:24:24.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2acb374b-9c87-4baa-8c52-f81ff3fc4ad9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95262024-12-18T22:24:24.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2acb374b-9c87-4baa-8c52-f81ff3fc4ad9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95272024-12-18T22:24:24.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2acb374b-9c87-4baa-8c52-f81ff3fc4ad9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95282024-12-18T22:24:25.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34ad1f4c-c910-47ee-8740-b8940525a0d7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95292024-12-18T22:24:25.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34ad1f4c-c910-47ee-8740-b8940525a0d7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95302024-12-18T22:24:25.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 34ad1f4c-c910-47ee-8740-b8940525a0d7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95312024-12-18T22:24:26.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 521bdec7-c4a7-4486-a511-e9c3cc6aadd6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95322024-12-18T22:24:26.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 521bdec7-c4a7-4486-a511-e9c3cc6aadd6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95332024-12-18T22:24:26.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 521bdec7-c4a7-4486-a511-e9c3cc6aadd6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95342024-12-18T22:24:26.627ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45876
95352024-12-18T22:24:26.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = cf255d43-93d0-433c-9277-6ec4a63657f9 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
95362024-12-18T22:24:26.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = cf255d43-93d0-433c-9277-6ec4a63657f9 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
95372024-12-18T22:24:26.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = cf255d43-93d0-433c-9277-6ec4a63657f9 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
95382024-12-18T22:24:26.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = eb5d3ff4-b538-4f20-9399-32c35946bfc3 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
95392024-12-18T22:24:26.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = eb5d3ff4-b538-4f20-9399-32c35946bfc3 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
95402024-12-18T22:24:26.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45876 req_id = eb5d3ff4-b538-4f20-9399-32c35946bfc3 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
95412024-12-18T22:24:26.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = b6fe3b0f-e58c-41a0-9bf4-7829bf7ce945 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
95422024-12-18T22:24:27.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02d5eae-a123-40c2-ae22-209bf8377e57 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95432024-12-18T22:24:27.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02d5eae-a123-40c2-ae22-209bf8377e57 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95442024-12-18T22:24:27.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e02d5eae-a123-40c2-ae22-209bf8377e57 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95452024-12-18T22:24:28.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4ef4c0f-4cfa-42f3-9500-f532453622a9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95462024-12-18T22:24:28.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4ef4c0f-4cfa-42f3-9500-f532453622a9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95472024-12-18T22:24:28.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4ef4c0f-4cfa-42f3-9500-f532453622a9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95482024-12-18T22:24:29.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 400094b7-1fab-4132-a369-eaf6798261cf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95492024-12-18T22:24:29.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 400094b7-1fab-4132-a369-eaf6798261cf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95502024-12-18T22:24:29.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 400094b7-1fab-4132-a369-eaf6798261cf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95512024-12-18T22:24:30.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7638551d-338e-4ad6-9114-97c7344628da roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95522024-12-18T22:24:30.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7638551d-338e-4ad6-9114-97c7344628da resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95532024-12-18T22:24:30.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7638551d-338e-4ad6-9114-97c7344628da response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95542024-12-18T22:24:31.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18ca66c9-b389-42ae-bd83-95bfa8b4bcd7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95552024-12-18T22:24:31.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18ca66c9-b389-42ae-bd83-95bfa8b4bcd7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95562024-12-18T22:24:31.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 18ca66c9-b389-42ae-bd83-95bfa8b4bcd7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95572024-12-18T22:24:32.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7718c6c2-523d-4b82-b552-f802dd7f44e7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95582024-12-18T22:24:32.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7718c6c2-523d-4b82-b552-f802dd7f44e7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95592024-12-18T22:24:32.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7718c6c2-523d-4b82-b552-f802dd7f44e7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95602024-12-18T22:24:33.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f6bf91e-a057-4c92-8334-82d22915455a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95612024-12-18T22:24:33.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f6bf91e-a057-4c92-8334-82d22915455a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95622024-12-18T22:24:33.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f6bf91e-a057-4c92-8334-82d22915455a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95632024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
95642024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95652024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
95662024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95672024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95682024-12-18T22:24:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95692024-12-18T22:24:33.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95702024-12-18T22:24:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95712024-12-18T22:24:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95722024-12-18T22:24:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95732024-12-18T22:24:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95742024-12-18T22:24:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95752024-12-18T22:24:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95762024-12-18T22:24:33.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
95772024-12-18T22:24:33.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95782024-12-18T22:24:33.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95792024-12-18T22:24:33.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
95802024-12-18T22:24:33.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.684825ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
95812024-12-18T22:24:33.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95822024-12-18T22:24:33.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95832024-12-18T22:24:33.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.146079ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95842024-12-18T22:24:34.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be1ce5d6-17a8-44e5-8234-1cd978ca48ea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95852024-12-18T22:24:34.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be1ce5d6-17a8-44e5-8234-1cd978ca48ea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95862024-12-18T22:24:34.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = be1ce5d6-17a8-44e5-8234-1cd978ca48ea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95872024-12-18T22:24:35.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f8f6cf9-bcb0-4c5f-bbff-dc7167d351e5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95882024-12-18T22:24:35.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f8f6cf9-bcb0-4c5f-bbff-dc7167d351e5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95892024-12-18T22:24:35.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f8f6cf9-bcb0-4c5f-bbff-dc7167d351e5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95902024-12-18T22:24:36.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d1a576d-06d2-4958-ad4d-4982afb9f446 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95912024-12-18T22:24:36.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d1a576d-06d2-4958-ad4d-4982afb9f446 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95922024-12-18T22:24:36.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d1a576d-06d2-4958-ad4d-4982afb9f446 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95932024-12-18T22:24:36.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 797 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 536d22f4-a8e3-47f4-91c2-2b01acaeed9c response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
95942024-12-18T22:24:37.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81885535-8c09-49c2-a1ff-18ab51ec29be roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95952024-12-18T22:24:37.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81885535-8c09-49c2-a1ff-18ab51ec29be resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95962024-12-18T22:24:37.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 81885535-8c09-49c2-a1ff-18ab51ec29be response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95972024-12-18T22:24:38.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454ae115-3053-4508-b28b-590347165e34 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95982024-12-18T22:24:38.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454ae115-3053-4508-b28b-590347165e34 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
95992024-12-18T22:24:38.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 454ae115-3053-4508-b28b-590347165e34 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96002024-12-18T22:24:39.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e70dab2-0b22-484b-afe5-f9eca56f5e82 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96012024-12-18T22:24:39.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e70dab2-0b22-484b-afe5-f9eca56f5e82 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96022024-12-18T22:24:39.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e70dab2-0b22-484b-afe5-f9eca56f5e82 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96032024-12-18T22:24:40.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 078fc2d8-ea5a-4e97-988e-c6993776c5f4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96042024-12-18T22:24:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 078fc2d8-ea5a-4e97-988e-c6993776c5f4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96052024-12-18T22:24:40.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 078fc2d8-ea5a-4e97-988e-c6993776c5f4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96062024-12-18T22:24:41.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5d4751c5-2b75-4e4e-bad5-e23d34de9c18 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96072024-12-18T22:24:41.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5d4751c5-2b75-4e4e-bad5-e23d34de9c18 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96082024-12-18T22:24:41.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5d4751c5-2b75-4e4e-bad5-e23d34de9c18 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96092024-12-18T22:24:42.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe760d6-03b7-4517-9c06-d080f02bb391 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96102024-12-18T22:24:42.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe760d6-03b7-4517-9c06-d080f02bb391 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96112024-12-18T22:24:42.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3fe760d6-03b7-4517-9c06-d080f02bb391 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96122024-12-18T22:24:43.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b025fc29-a05c-4895-8c41-57e6e33aefd2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
96132024-12-18T22:24:43.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b025fc29-a05c-4895-8c41-57e6e33aefd2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
96142024-12-18T22:24:43.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = b025fc29-a05c-4895-8c41-57e6e33aefd2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
96152024-12-18T22:24:43.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed75407f-3922-4b5d-b45c-9fb31ab70034 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96162024-12-18T22:24:43.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed75407f-3922-4b5d-b45c-9fb31ab70034 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96172024-12-18T22:24:43.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ed75407f-3922-4b5d-b45c-9fb31ab70034 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
96182024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
96192024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
96202024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96212024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96222024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
96232024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
96242024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96252024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96262024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
96272024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96282024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
96292024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96302024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
96312024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
96322024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96332024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96342024-12-18T22:24:43.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
96352024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96362024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
96372024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96382024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
96392024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96402024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
96412024-12-18T22:24:43.797ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96422024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
96432024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96442024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96452024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
96462024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96472024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96482024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
96492024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96502024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
96512024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
96522024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96532024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96542024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96552024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96562024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96572024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96582024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96592024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96602024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96612024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96622024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96632024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96642024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96652024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96662024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96672024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96682024-12-18T22:24:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96692024-12-18T22:24:43.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96702024-12-18T22:24:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.332596ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96712024-12-18T22:24:43.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96722024-12-18T22:24:43.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 419049591 } })
96732024-12-18T22:24:43.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96742024-12-18T22:24:43.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96752024-12-18T22:24:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96762024-12-18T22:24:43.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96772024-12-18T22:24:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96782024-12-18T22:24:43.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96792024-12-18T22:24:43.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.65595ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
96802024-12-18T22:24:43.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96812024-12-18T22:24:43.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96822024-12-18T22:24:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96832024-12-18T22:24:43.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96842024-12-18T22:24:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96852024-12-18T22:24:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96862024-12-18T22:24:43.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96872024-12-18T22:24:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96882024-12-18T22:24:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96892024-12-18T22:24:43.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96902024-12-18T22:24:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96912024-12-18T22:24:43.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922024-12-18T22:24:43.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96932024-12-18T22:24:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96942024-12-18T22:24:43.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96952024-12-18T22:24:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96962024-12-18T22:24:43.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 428943375 } })
96972024-12-18T22:24:43.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96982024-12-18T22:24:43.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96992024-12-18T22:24:43.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97002024-12-18T22:24:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97012024-12-18T22:24:43.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97022024-12-18T22:24:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97032024-12-18T22:24:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97042024-12-18T22:24:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97052024-12-18T22:24:43.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97062024-12-18T22:24:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97072024-12-18T22:24:43.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97082024-12-18T22:24:43.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 433310671 } })
97092024-12-18T22:24:43.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
97102024-12-18T22:24:43.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97112024-12-18T22:24:43.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97122024-12-18T22:24:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97132024-12-18T22:24:43.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97142024-12-18T22:24:43.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97152024-12-18T22:24:43.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97162024-12-18T22:24:43.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97172024-12-18T22:24:43.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97182024-12-18T22:24:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
97192024-12-18T22:24:43.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97202024-12-18T22:24:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97212024-12-18T22:24:43.834ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
97222024-12-18T22:24:43.834ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.891203ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
97232024-12-18T22:24:43.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.668898ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
97242024-12-18T22:24:43.839ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97252024-12-18T22:24:43.839ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97262024-12-18T22:24:43.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97272024-12-18T22:24:43.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97282024-12-18T22:24:43.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97292024-12-18T22:24:43.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97302024-12-18T22:24:43.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97312024-12-18T22:24:43.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97322024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97332024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97342024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97352024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97362024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97372024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97382024-12-18T22:24:43.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97392024-12-18T22:24:43.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97402024-12-18T22:24:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97412024-12-18T22:24:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97422024-12-18T22:24:43.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97432024-12-18T22:24:43.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.026533ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97442024-12-18T22:24:43.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.789467ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97452024-12-18T22:24:43.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.332818ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97462024-12-18T22:24:43.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
97472024-12-18T22:24:43.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97482024-12-18T22:24:43.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97492024-12-18T22:24:43.847ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97502024-12-18T22:24:43.847ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.583273ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97512024-12-18T22:24:43.848ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.512011ms iteration = 22 status = 0
97522024-12-18T22:24:43.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97532024-12-18T22:24:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97542024-12-18T22:24:43.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97552024-12-18T22:24:43.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97562024-12-18T22:24:43.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97572024-12-18T22:24:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97582024-12-18T22:24:43.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97592024-12-18T22:24:43.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97602024-12-18T22:24:43.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97612024-12-18T22:24:43.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97622024-12-18T22:24:43.870ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97632024-12-18T22:24:43.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97642024-12-18T22:24:43.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97652024-12-18T22:24:43.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97662024-12-18T22:24:43.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.213682ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97672024-12-18T22:24:43.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97682024-12-18T22:24:43.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97692024-12-18T22:24:43.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.508951ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97702024-12-18T22:24:43.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
97712024-12-18T22:24:43.910ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97722024-12-18T22:24:43.910ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1525a6a3-875f-49d0-8976-aff52e068dad", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
97732024-12-18T22:24:43.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97742024-12-18T22:24:43.912ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
97752024-12-18T22:24:43.926ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.45086ms iteration = 25 status = {"physical_disks_added":0}
97762024-12-18T22:24:43.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97772024-12-18T22:24:43.972ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97782024-12-18T22:24:43.972ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3621787-c072-45be-8a67-1983a4c29f7b", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
97792024-12-18T22:24:43.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97802024-12-18T22:24:43.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97812024-12-18T22:24:44.012ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97822024-12-18T22:24:44.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97832024-12-18T22:24:44.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4066e7-233a-4c87-84d0-cc717b13e96c", "content-length": "372", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
97842024-12-18T22:24:44.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97852024-12-18T22:24:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97862024-12-18T22:24:44.018ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97872024-12-18T22:24:44.018ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97882024-12-18T22:24:44.019ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b10f139f-300c-44e8-a747-53ac838bad37", "content-length": "26", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
97892024-12-18T22:24:44.019ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97902024-12-18T22:24:44.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97912024-12-18T22:24:44.044ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
97922024-12-18T22:24:44.045ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e2a6396-e5f8-4ee9-a34a-229d34cee9bb", "content-length": "691", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
97932024-12-18T22:24:44.045ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
97942024-12-18T22:24:44.045ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
97952024-12-18T22:24:44.045ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
97962024-12-18T22:24:44.046ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 250.003535ms iteration = 22 status = {}
97972024-12-18T22:24:44.053ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
97982024-12-18T22:24:44.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97992024-12-18T22:24:44.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4f71697a-856c-4720-b13e-563e5a07d39f", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
98002024-12-18T22:24:44.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98012024-12-18T22:24:44.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98022024-12-18T22:24:44.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-12-18T22:24:44.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-12-18T22:24:44.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98052024-12-18T22:24:44.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98062024-12-18T22:24:44.061ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98072024-12-18T22:24:44.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98082024-12-18T22:24:44.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1bfbdf2-65f7-4eb2-a359-8530f6b4fa86", "date": "Wed, 18 Dec 2024 22:24:43 GMT"} })
98092024-12-18T22:24:44.063ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.617851ms iteration = 22 status = {}
98102024-12-18T22:24:44.089ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 292.880156ms iteration = 22 status = {}
98112024-12-18T22:24:44.091ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98122024-12-18T22:24:44.091ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c8837b-1d6d-449d-8fab-194f5e9a31d1", "content-length": "1", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98132024-12-18T22:24:44.093ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98142024-12-18T22:24:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98152024-12-18T22:24:44.096ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.016856ms iteration = 22 status = null
98162024-12-18T22:24:44.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98172024-12-18T22:24:44.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98182024-12-18T22:24:44.132ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
98192024-12-18T22:24:44.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98202024-12-18T22:24:44.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98212024-12-18T22:24:44.139ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98222024-12-18T22:24:44.139ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfb53e8f-8795-4919-b3be-e7d5993c82b8", "content-length": "134", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98232024-12-18T22:24:44.139ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98242024-12-18T22:24:44.139ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
98252024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98262024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98272024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98282024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98292024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98302024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98312024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98322024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98332024-12-18T22:24:44.140ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
98342024-12-18T22:24:44.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98352024-12-18T22:24:44.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98362024-12-18T22:24:44.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98372024-12-18T22:24:44.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "df21b9f8-ce9a-4d01-a394-cdfa16119ba9", "content-length": "2", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98382024-12-18T22:24:44.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98392024-12-18T22:24:44.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "781a93b0-f84e-4453-9590-bf992552335a", "content-length": "52", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98402024-12-18T22:24:44.142ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
98412024-12-18T22:24:44.142ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98422024-12-18T22:24:44.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c8a705ff-c48e-483d-999f-f4ca89fec2ed", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98432024-12-18T22:24:44.238ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
98442024-12-18T22:24:44.238ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98452024-12-18T22:24:44.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "67f75c96-3885-4337-b070-0c1379056c9f", "content-length": "682", "date": "Wed, 18 Dec 2024 22:24:44 GMT"} })
98462024-12-18T22:24:44.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98472024-12-18T22:24:44.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98482024-12-18T22:24:44.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98492024-12-18T22:24:44.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98502024-12-18T22:24:44.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98512024-12-18T22:24:44.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98522024-12-18T22:24:44.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98532024-12-18T22:24:44.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98542024-12-18T22:24:44.254ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 457.447076ms iteration = 22 status = {}
98552024-12-18T22:24:44.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62c87ff3-2f75-4a86-97dd-defd7a0c6c59 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98562024-12-18T22:24:44.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62c87ff3-2f75-4a86-97dd-defd7a0c6c59 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98572024-12-18T22:24:44.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 62c87ff3-2f75-4a86-97dd-defd7a0c6c59 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98582024-12-18T22:24:45.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 928c8278-f5dc-465b-a3a4-277a63c8a554 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98592024-12-18T22:24:45.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 928c8278-f5dc-465b-a3a4-277a63c8a554 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98602024-12-18T22:24:45.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 928c8278-f5dc-465b-a3a4-277a63c8a554 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98612024-12-18T22:24:46.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 539 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = aecc6c1b-fb0b-41c1-bc2f-cf6798ba0046 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
98622024-12-18T22:24:46.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68bc413c-f61c-493f-b670-40e069c24953 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98632024-12-18T22:24:46.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68bc413c-f61c-493f-b670-40e069c24953 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98642024-12-18T22:24:46.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68bc413c-f61c-493f-b670-40e069c24953 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98652024-12-18T22:24:47.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c9f30b1-c04e-4b7d-96ea-05d5bac072b1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98662024-12-18T22:24:47.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c9f30b1-c04e-4b7d-96ea-05d5bac072b1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98672024-12-18T22:24:47.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2c9f30b1-c04e-4b7d-96ea-05d5bac072b1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98682024-12-18T22:24:48.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215d76e1-624e-444c-b187-953165217a54 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98692024-12-18T22:24:48.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215d76e1-624e-444c-b187-953165217a54 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98702024-12-18T22:24:48.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 215d76e1-624e-444c-b187-953165217a54 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98712024-12-18T22:24:49.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 52a371d7-8de5-4e0c-afce-d41edf5642d8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98722024-12-18T22:24:49.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 52a371d7-8de5-4e0c-afce-d41edf5642d8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98732024-12-18T22:24:49.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 52a371d7-8de5-4e0c-afce-d41edf5642d8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98742024-12-18T22:24:50.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac9694ae-1252-4c69-8afa-ce2a4a47e437 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98752024-12-18T22:24:50.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac9694ae-1252-4c69-8afa-ce2a4a47e437 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98762024-12-18T22:24:50.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ac9694ae-1252-4c69-8afa-ce2a4a47e437 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98772024-12-18T22:24:51.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3f12430-4414-4a37-843c-990f25af08bf roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98782024-12-18T22:24:51.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3f12430-4414-4a37-843c-990f25af08bf resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98792024-12-18T22:24:51.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d3f12430-4414-4a37-843c-990f25af08bf response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98802024-12-18T22:24:52.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 209a6f08-4139-46d6-a171-6fd29f9acc27 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98812024-12-18T22:24:52.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 209a6f08-4139-46d6-a171-6fd29f9acc27 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98822024-12-18T22:24:52.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 209a6f08-4139-46d6-a171-6fd29f9acc27 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
98832024-12-18T22:24:53.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
98842024-12-18T22:24:53.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
98852024-12-18T22:24:53.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98862024-12-18T22:24:53.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98872024-12-18T22:24:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98882024-12-18T22:24:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98892024-12-18T22:24:53.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98902024-12-18T22:24:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98912024-12-18T22:24:53.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98922024-12-18T22:24:53.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.157822ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98932024-12-18T22:24:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98942024-12-18T22:24:53.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98952024-12-18T22:24:53.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98962024-12-18T22:24:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98972024-12-18T22:24:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98982024-12-18T22:24:53.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98992024-12-18T22:24:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
99002024-12-18T22:24:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99012024-12-18T22:24:53.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99022024-12-18T22:24:53.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
99032024-12-18T22:24:53.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.601055ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
99042024-12-18T22:24:53.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38dda9-1a11-451e-908b-9ba015a3ca3e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99052024-12-18T22:24:53.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38dda9-1a11-451e-908b-9ba015a3ca3e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99062024-12-18T22:24:53.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc38dda9-1a11-451e-908b-9ba015a3ca3e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99072024-12-18T22:24:54.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7fb60d2-9465-430e-83c4-5a8a785bebdc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99082024-12-18T22:24:54.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7fb60d2-9465-430e-83c4-5a8a785bebdc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99092024-12-18T22:24:54.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7fb60d2-9465-430e-83c4-5a8a785bebdc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99102024-12-18T22:24:55.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c172044e-7a01-45ee-a00d-7e03f516a8f8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99112024-12-18T22:24:56.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c172044e-7a01-45ee-a00d-7e03f516a8f8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99122024-12-18T22:24:56.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c172044e-7a01-45ee-a00d-7e03f516a8f8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99132024-12-18T22:24:56.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 74953ff3-b34f-4971-91a6-bab8fcdac1ac response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
99142024-12-18T22:24:57.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7099fa4-bf41-4e44-bd5d-129d35be3b3d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99152024-12-18T22:24:57.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7099fa4-bf41-4e44-bd5d-129d35be3b3d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99162024-12-18T22:24:57.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7099fa4-bf41-4e44-bd5d-129d35be3b3d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99172024-12-18T22:24:58.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e09e33d-dc47-45a9-88b9-829c1041e02d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99182024-12-18T22:24:58.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e09e33d-dc47-45a9-88b9-829c1041e02d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99192024-12-18T22:24:58.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e09e33d-dc47-45a9-88b9-829c1041e02d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99202024-12-18T22:24:59.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90128abd-a1de-4f85-a559-c2948615a0fd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99212024-12-18T22:24:59.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90128abd-a1de-4f85-a559-c2948615a0fd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99222024-12-18T22:24:59.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 90128abd-a1de-4f85-a559-c2948615a0fd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99232024-12-18T22:25:00.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5117f0f6-f4d1-45ef-bd6b-c8e03f7d8175 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99242024-12-18T22:25:00.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5117f0f6-f4d1-45ef-bd6b-c8e03f7d8175 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99252024-12-18T22:25:00.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5117f0f6-f4d1-45ef-bd6b-c8e03f7d8175 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99262024-12-18T22:25:01.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f0f08ec4-a13e-494c-8bc0-09d12c2f3a08 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99272024-12-18T22:25:01.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f0f08ec4-a13e-494c-8bc0-09d12c2f3a08 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99282024-12-18T22:25:01.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f0f08ec4-a13e-494c-8bc0-09d12c2f3a08 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99292024-12-18T22:25:02.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c938f1d8-0603-4193-89de-bb076e579f62 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99302024-12-18T22:25:02.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c938f1d8-0603-4193-89de-bb076e579f62 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99312024-12-18T22:25:02.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c938f1d8-0603-4193-89de-bb076e579f62 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99322024-12-18T22:25:03.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12a6e0b7-f1de-48be-abee-39a57fed2579 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99332024-12-18T22:25:03.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12a6e0b7-f1de-48be-abee-39a57fed2579 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99342024-12-18T22:25:03.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12a6e0b7-f1de-48be-abee-39a57fed2579 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99352024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
99362024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
99372024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99382024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99392024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99402024-12-18T22:25:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99412024-12-18T22:25:03.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99422024-12-18T22:25:03.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99432024-12-18T22:25:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99442024-12-18T22:25:03.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.769624ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99452024-12-18T22:25:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99462024-12-18T22:25:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99472024-12-18T22:25:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99482024-12-18T22:25:03.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99492024-12-18T22:25:03.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99502024-12-18T22:25:03.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99512024-12-18T22:25:03.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
99522024-12-18T22:25:03.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99532024-12-18T22:25:03.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99542024-12-18T22:25:03.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
99552024-12-18T22:25:03.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.043803ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
99562024-12-18T22:25:04.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1605cc31-0fb7-48db-8c75-a8144979de4d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99572024-12-18T22:25:04.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1605cc31-0fb7-48db-8c75-a8144979de4d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99582024-12-18T22:25:04.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1605cc31-0fb7-48db-8c75-a8144979de4d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99592024-12-18T22:25:05.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8a0d612-e730-40af-a118-b5058798b6e3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99602024-12-18T22:25:05.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8a0d612-e730-40af-a118-b5058798b6e3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99612024-12-18T22:25:05.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b8a0d612-e730-40af-a118-b5058798b6e3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99622024-12-18T22:25:06.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1227e193-1875-4491-a9e6-20bbf4ff7cce roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99632024-12-18T22:25:06.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1227e193-1875-4491-a9e6-20bbf4ff7cce resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99642024-12-18T22:25:06.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1227e193-1875-4491-a9e6-20bbf4ff7cce response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99652024-12-18T22:25:06.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 8bb59fc5-b080-48ed-9672-7abada3146f2 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
99662024-12-18T22:25:07.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706d191d-a433-4905-838e-9eb858c27308 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99672024-12-18T22:25:07.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706d191d-a433-4905-838e-9eb858c27308 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99682024-12-18T22:25:07.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706d191d-a433-4905-838e-9eb858c27308 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99692024-12-18T22:25:08.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e3110b6a-4222-46cb-9d34-35a2780542f3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99702024-12-18T22:25:08.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e3110b6a-4222-46cb-9d34-35a2780542f3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99712024-12-18T22:25:08.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e3110b6a-4222-46cb-9d34-35a2780542f3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99722024-12-18T22:25:09.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3c0e87f-ad12-4bf3-bf88-88a33884796a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99732024-12-18T22:25:09.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3c0e87f-ad12-4bf3-bf88-88a33884796a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99742024-12-18T22:25:09.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a3c0e87f-ad12-4bf3-bf88-88a33884796a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99752024-12-18T22:25:10.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb00c92c-ca21-4a65-9575-77acba0c4ca1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99762024-12-18T22:25:10.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb00c92c-ca21-4a65-9575-77acba0c4ca1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99772024-12-18T22:25:10.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb00c92c-ca21-4a65-9575-77acba0c4ca1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99782024-12-18T22:25:11.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 93531dbf-4b55-4953-abb8-40858cd852c0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99792024-12-18T22:25:11.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 93531dbf-4b55-4953-abb8-40858cd852c0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99802024-12-18T22:25:11.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 93531dbf-4b55-4953-abb8-40858cd852c0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99812024-12-18T22:25:12.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3943dbc1-e10c-406e-9698-550bb6a1a569 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99822024-12-18T22:25:12.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3943dbc1-e10c-406e-9698-550bb6a1a569 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99832024-12-18T22:25:12.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3943dbc1-e10c-406e-9698-550bb6a1a569 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99842024-12-18T22:25:13.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2eaed1b3-b8dd-4c56-a821-1f94f8c4d00e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99852024-12-18T22:25:13.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2eaed1b3-b8dd-4c56-a821-1f94f8c4d00e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99862024-12-18T22:25:13.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2eaed1b3-b8dd-4c56-a821-1f94f8c4d00e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
99872024-12-18T22:25:13.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f38662a1-ef93-49c8-9308-953d4035876d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
99882024-12-18T22:25:13.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f38662a1-ef93-49c8-9308-953d4035876d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
99892024-12-18T22:25:13.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f38662a1-ef93-49c8-9308-953d4035876d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
99902024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
99912024-12-18T22:25:13.797ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
99922024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
99932024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99942024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99952024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
99962024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99972024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
99982024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
99992024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100002024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100012024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100022024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
100032024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
100042024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100052024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
100062024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100072024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
100082024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
100092024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100102024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
100112024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100122024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
100132024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100142024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
100152024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
100162024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
100172024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100182024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100192024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
100202024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
100212024-12-18T22:25:13.797ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100222024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100232024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
100242024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100252024-12-18T22:25:13.797ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
100262024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.35\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
100272024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
100282024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
100292024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100302024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
100312024-12-18T22:25:13.797ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:15:13.797839489 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100322024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
100332024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100342024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100352024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
100362024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100372024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
100382024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
100392024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
100402024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100412024-12-18T22:25:13.797ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100422024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
100432024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
100442024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100452024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100462024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100472024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
100482024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100492024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
100502024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100512024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100522024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100532024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100542024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100552024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100562024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100572024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100582024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100592024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100602024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100612024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100622024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100632024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100642024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100652024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100662024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100672024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100682024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100692024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100702024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100712024-12-18T22:25:13.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 416554302 } })
100722024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100732024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100742024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100752024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100762024-12-18T22:25:13.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 416581753 } })
100772024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100782024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
100792024-12-18T22:25:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.314206ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
100802024-12-18T22:25:13.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
100812024-12-18T22:25:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.375127ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
100822024-12-18T22:25:13.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100832024-12-18T22:25:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100842024-12-18T22:25:13.800ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100852024-12-18T22:25:13.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100862024-12-18T22:25:13.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100872024-12-18T22:25:13.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.910457ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100882024-12-18T22:25:13.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
100892024-12-18T22:25:13.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100902024-12-18T22:25:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100912024-12-18T22:25:13.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100922024-12-18T22:25:13.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.973967ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
100932024-12-18T22:25:13.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100942024-12-18T22:25:13.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100952024-12-18T22:25:13.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100962024-12-18T22:25:13.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 423590781 } })
100972024-12-18T22:25:13.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 423865386 } })
100982024-12-18T22:25:13.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100992024-12-18T22:25:13.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101002024-12-18T22:25:13.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101012024-12-18T22:25:13.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101022024-12-18T22:25:13.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101032024-12-18T22:25:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101042024-12-18T22:25:13.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101052024-12-18T22:25:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101062024-12-18T22:25:13.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101072024-12-18T22:25:13.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101082024-12-18T22:25:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101092024-12-18T22:25:13.810ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.959275ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
101102024-12-18T22:25:13.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101112024-12-18T22:25:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101122024-12-18T22:25:13.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101132024-12-18T22:25:13.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101142024-12-18T22:25:13.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101152024-12-18T22:25:13.813ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101162024-12-18T22:25:13.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101172024-12-18T22:25:13.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101182024-12-18T22:25:13.815ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:15:13.797839489 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
101192024-12-18T22:25:13.815ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.430091ms iteration = 12 status = {"expiration":"2024-12-18T22:15:13.797839489Z","pruned":[]}
101202024-12-18T22:25:13.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101212024-12-18T22:25:13.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101222024-12-18T22:25:13.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101232024-12-18T22:25:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101242024-12-18T22:25:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101252024-12-18T22:25:13.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101262024-12-18T22:25:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101272024-12-18T22:25:13.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101282024-12-18T22:25:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101292024-12-18T22:25:13.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101302024-12-18T22:25:13.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 440798928 } })
101312024-12-18T22:25:13.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
101322024-12-18T22:25:13.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101332024-12-18T22:25:13.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101342024-12-18T22:25:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101352024-12-18T22:25:13.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101362024-12-18T22:25:13.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101372024-12-18T22:25:13.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101382024-12-18T22:25:13.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101392024-12-18T22:25:13.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101402024-12-18T22:25:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101412024-12-18T22:25:13.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101422024-12-18T22:25:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101432024-12-18T22:25:13.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101442024-12-18T22:25:13.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101452024-12-18T22:25:13.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101462024-12-18T22:25:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
101472024-12-18T22:25:13.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101482024-12-18T22:25:13.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101492024-12-18T22:25:13.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101502024-12-18T22:25:13.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.626092ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
101512024-12-18T22:25:13.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101522024-12-18T22:25:13.853ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101532024-12-18T22:25:13.853ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101542024-12-18T22:25:13.853ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.07483ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101552024-12-18T22:25:13.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.100254ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101562024-12-18T22:25:13.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101572024-12-18T22:25:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101582024-12-18T22:25:13.873ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
101592024-12-18T22:25:13.873ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
101602024-12-18T22:25:13.873ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.45033ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
101612024-12-18T22:25:13.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101622024-12-18T22:25:13.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101632024-12-18T22:25:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101642024-12-18T22:25:13.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
101652024-12-18T22:25:13.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.141673ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
101662024-12-18T22:25:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101672024-12-18T22:25:13.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101682024-12-18T22:25:13.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101692024-12-18T22:25:13.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101702024-12-18T22:25:13.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101712024-12-18T22:25:13.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101722024-12-18T22:25:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101732024-12-18T22:25:13.880ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101742024-12-18T22:25:13.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.998469ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101752024-12-18T22:25:13.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
101762024-12-18T22:25:13.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101772024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101782024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101792024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101802024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101812024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101822024-12-18T22:25:13.882ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101832024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101842024-12-18T22:25:13.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101852024-12-18T22:25:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101862024-12-18T22:25:13.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101872024-12-18T22:25:13.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101882024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101892024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
101902024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
101912024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
101922024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101932024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101942024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101952024-12-18T22:25:13.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101962024-12-18T22:25:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101972024-12-18T22:25:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101982024-12-18T22:25:13.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101992024-12-18T22:25:13.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102002024-12-18T22:25:13.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.18659ms iteration = 23 status = 0
102012024-12-18T22:25:13.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.433534ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102022024-12-18T22:25:13.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102032024-12-18T22:25:13.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102042024-12-18T22:25:13.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102052024-12-18T22:25:13.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102062024-12-18T22:25:13.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102072024-12-18T22:25:13.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102082024-12-18T22:25:13.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102092024-12-18T22:25:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102102024-12-18T22:25:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102112024-12-18T22:25:13.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102122024-12-18T22:25:13.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102132024-12-18T22:25:13.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102142024-12-18T22:25:13.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102152024-12-18T22:25:13.894ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102162024-12-18T22:25:13.894ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102172024-12-18T22:25:13.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102182024-12-18T22:25:13.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102192024-12-18T22:25:13.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102202024-12-18T22:25:13.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102212024-12-18T22:25:13.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102222024-12-18T22:25:13.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.070685ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
102232024-12-18T22:25:13.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102242024-12-18T22:25:13.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102252024-12-18T22:25:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102262024-12-18T22:25:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102272024-12-18T22:25:13.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102282024-12-18T22:25:13.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102292024-12-18T22:25:13.901ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
102302024-12-18T22:25:13.901ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102312024-12-18T22:25:13.901ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
102322024-12-18T22:25:13.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 103.646584ms iteration = 12 status = {"generation":1}
102332024-12-18T22:25:13.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.844077ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102342024-12-18T22:25:13.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102352024-12-18T22:25:13.918ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102362024-12-18T22:25:13.918ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102372024-12-18T22:25:13.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.480254ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102382024-12-18T22:25:13.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102392024-12-18T22:25:13.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102402024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102412024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102422024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102432024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102442024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102452024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102462024-12-18T22:25:13.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102472024-12-18T22:25:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102482024-12-18T22:25:13.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102492024-12-18T22:25:13.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102502024-12-18T22:25:13.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102512024-12-18T22:25:13.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102522024-12-18T22:25:13.984ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.694213ms iteration = 26 status = {"physical_disks_added":0}
102532024-12-18T22:25:13.992ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102542024-12-18T22:25:13.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.584118ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
102552024-12-18T22:25:14.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
102562024-12-18T22:25:14.044ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102572024-12-18T22:25:14.044ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5811444a-bcac-4188-9680-12246d5e4eec", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
102582024-12-18T22:25:14.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102592024-12-18T22:25:14.047ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
102602024-12-18T22:25:14.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102612024-12-18T22:25:14.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "18049f69-21b0-4fc1-b32e-366537590cde", "content-length": "691", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
102622024-12-18T22:25:14.060ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102632024-12-18T22:25:14.060ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102642024-12-18T22:25:14.060ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102652024-12-18T22:25:14.062ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 264.319295ms iteration = 23 status = {}
102662024-12-18T22:25:14.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102672024-12-18T22:25:14.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
102682024-12-18T22:25:14.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102692024-12-18T22:25:14.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102702024-12-18T22:25:14.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102712024-12-18T22:25:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102722024-12-18T22:25:14.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102732024-12-18T22:25:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102742024-12-18T22:25:14.069ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
102752024-12-18T22:25:14.069ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102762024-12-18T22:25:14.069ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
102772024-12-18T22:25:14.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 271.458406ms iteration = 12 status = {"generation":2}
102782024-12-18T22:25:14.093ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
102792024-12-18T22:25:14.093ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 295.343675ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102802024-12-18T22:25:14.109ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102812024-12-18T22:25:14.109ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102822024-12-18T22:25:14.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "297c632e-4d9a-4a48-a610-cdeac2bd146e", "content-length": "372", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
102832024-12-18T22:25:14.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102842024-12-18T22:25:14.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102852024-12-18T22:25:14.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102862024-12-18T22:25:14.116ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102872024-12-18T22:25:14.116ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102882024-12-18T22:25:14.117ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "120996a0-926b-4e55-bba6-c454147b5f17", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
102892024-12-18T22:25:14.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102902024-12-18T22:25:14.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102912024-12-18T22:25:14.122ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
102922024-12-18T22:25:14.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102932024-12-18T22:25:14.131ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102942024-12-18T22:25:14.131ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62ce3127-d8ca-4740-b35f-0c3ac20ed6b8", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
102952024-12-18T22:25:14.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102962024-12-18T22:25:14.132ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102972024-12-18T22:25:14.150ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102982024-12-18T22:25:14.150ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102992024-12-18T22:25:14.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a9923756-7ba0-4a59-8454-41c7d0c881e8", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
103002024-12-18T22:25:14.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103012024-12-18T22:25:14.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103022024-12-18T22:25:14.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103032024-12-18T22:25:14.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103042024-12-18T22:25:14.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103052024-12-18T22:25:14.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103062024-12-18T22:25:14.159ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103072024-12-18T22:25:14.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103082024-12-18T22:25:14.160ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d0997a99-aa01-416e-81bd-edbe7695b40b", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
103092024-12-18T22:25:14.162ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.374469ms iteration = 23 status = {}
103102024-12-18T22:25:14.245ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103112024-12-18T22:25:14.246ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd2b875-cdf2-429c-bb33-e99bfa0bd93f", "content-length": "1", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
103122024-12-18T22:25:14.248ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103132024-12-18T22:25:14.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103142024-12-18T22:25:14.250ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 452.986598ms iteration = 23 status = null
103152024-12-18T22:25:14.255ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.564038ms iteration = 23 status = {}
103162024-12-18T22:25:14.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103172024-12-18T22:25:14.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
103182024-12-18T22:25:14.358ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "85d8c69e-398c-409a-99c5-eb910ee0cfb5", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103192024-12-18T22:25:14.358ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103202024-12-18T22:25:14.361ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "793a18f5-b595-43df-8e57-f1a2cfcba996", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103212024-12-18T22:25:14.361ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103222024-12-18T22:25:14.362ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103232024-12-18T22:25:14.362ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 564.873093ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103242024-12-18T22:25:14.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103252024-12-18T22:25:14.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103262024-12-18T22:25:14.369ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
103272024-12-18T22:25:14.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103282024-12-18T22:25:14.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103292024-12-18T22:25:14.379ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103302024-12-18T22:25:14.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "04590c4c-dab0-4006-8795-842b469ec1f3", "content-length": "134", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
103312024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103322024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
103332024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103342024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103352024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103362024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103372024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103382024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103392024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103402024-12-18T22:25:14.380ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103412024-12-18T22:25:14.381ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
103422024-12-18T22:25:14.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103432024-12-18T22:25:14.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103442024-12-18T22:25:14.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103452024-12-18T22:25:14.382ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d1d786d-bb07-4c93-a656-8796279f4157", "content-length": "2", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
103462024-12-18T22:25:14.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103472024-12-18T22:25:14.382ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "185836fa-6ec6-4fd7-b39d-c11c7a4dd4ff", "content-length": "52", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
103482024-12-18T22:25:14.382ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
103492024-12-18T22:25:14.382ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103502024-12-18T22:25:14.387ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103512024-12-18T22:25:14.387ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dd91fc3e-3991-4f3c-bee4-dd15e2b83554", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103522024-12-18T22:25:14.387ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103532024-12-18T22:25:14.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c50a252a-487d-43f3-8e0d-3b1af23a90a6", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103542024-12-18T22:25:14.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103552024-12-18T22:25:14.391ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e425cca1-52c5-4ec5-906d-289628f940d1", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103562024-12-18T22:25:14.391ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103572024-12-18T22:25:14.392ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
103582024-12-18T22:25:14.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 594.715179ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103592024-12-18T22:25:14.482ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc3f7b17-8ca9-46a9-9231-9408acad8bfe", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
103602024-12-18T22:25:14.482ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
103612024-12-18T22:25:14.482ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103622024-12-18T22:25:14.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2fa05a8-6731-4bde-8db7-b91fc498e86a", "content-length": "682", "date": "Wed, 18 Dec 2024 22:25:13 GMT"} })
103632024-12-18T22:25:14.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103642024-12-18T22:25:14.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103652024-12-18T22:25:14.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103662024-12-18T22:25:14.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103672024-12-18T22:25:14.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f8f787a-42b8-4f62-bec4-30c48ae4a052 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103682024-12-18T22:25:14.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f8f787a-42b8-4f62-bec4-30c48ae4a052 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103692024-12-18T22:25:14.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103702024-12-18T22:25:14.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103712024-12-18T22:25:14.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6f8f787a-42b8-4f62-bec4-30c48ae4a052 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103722024-12-18T22:25:14.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103732024-12-18T22:25:14.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103742024-12-18T22:25:14.500ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.606784ms iteration = 23 status = {}
103752024-12-18T22:25:14.565ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
103762024-12-18T22:25:14.565ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
103772024-12-18T22:25:14.596ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
103782024-12-18T22:25:14.596ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57343
103792024-12-18T22:25:14.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57343 req_id = 7e4ce58b-6619-423d-ae86-921973c6f3f2 roles = RoleSet { roles: {} } uri = /metrics/producers
103802024-12-18T22:25:14.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57343 req_id = 7e4ce58b-6619-423d-ae86-921973c6f3f2 resource = Database result = Ok(()) uri = /metrics/producers
103812024-12-18T22:25:14.644ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
103822024-12-18T22:25:14.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48165 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57343 req_id = 7e4ce58b-6619-423d-ae86-921973c6f3f2 response_code = 201 uri = /metrics/producers
103832024-12-18T22:25:14.644ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7e4ce58b-6619-423d-ae86-921973c6f3f2", "content-length": "41", "date": "Wed, 18 Dec 2024 22:25:14 GMT"} })
103842024-12-18T22:25:14.645ZDEBGnexus (producer-registration-task): registered with nexus successfully
103852024-12-18T22:25:14.645ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
103862024-12-18T22:25:15.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7503bd6f-bc61-4d71-92aa-16f199edb72a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103872024-12-18T22:25:15.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7503bd6f-bc61-4d71-92aa-16f199edb72a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103882024-12-18T22:25:15.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7503bd6f-bc61-4d71-92aa-16f199edb72a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103892024-12-18T22:25:16.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9cd421a0-cf03-48ab-a096-b58bda89bbd7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103902024-12-18T22:25:16.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9cd421a0-cf03-48ab-a096-b58bda89bbd7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103912024-12-18T22:25:16.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9cd421a0-cf03-48ab-a096-b58bda89bbd7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103922024-12-18T22:25:16.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = c42f0760-c84e-48bb-a983-f52670a070ab response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
103932024-12-18T22:25:17.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f5c4bc-75d1-4895-a164-3b65294a816d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103942024-12-18T22:25:17.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f5c4bc-75d1-4895-a164-3b65294a816d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103952024-12-18T22:25:17.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 26f5c4bc-75d1-4895-a164-3b65294a816d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103962024-12-18T22:25:18.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4983fd6e-489f-4346-9e8e-42bab0232888 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103972024-12-18T22:25:18.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4983fd6e-489f-4346-9e8e-42bab0232888 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103982024-12-18T22:25:18.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4983fd6e-489f-4346-9e8e-42bab0232888 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
103992024-12-18T22:25:19.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 269b6def-a666-4022-98c3-8ad974175bef roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104002024-12-18T22:25:19.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 269b6def-a666-4022-98c3-8ad974175bef resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104012024-12-18T22:25:19.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 269b6def-a666-4022-98c3-8ad974175bef response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104022024-12-18T22:25:20.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f24592-481a-42e6-88f7-df1ad9d74136 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104032024-12-18T22:25:20.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f24592-481a-42e6-88f7-df1ad9d74136 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104042024-12-18T22:25:20.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27f24592-481a-42e6-88f7-df1ad9d74136 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104052024-12-18T22:25:21.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 884a7e34-6baf-4aee-952d-c4608ff99d9c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104062024-12-18T22:25:21.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 884a7e34-6baf-4aee-952d-c4608ff99d9c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104072024-12-18T22:25:21.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 884a7e34-6baf-4aee-952d-c4608ff99d9c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104082024-12-18T22:25:22.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7197e005-4815-4c91-aa54-5dabc5d62358 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104092024-12-18T22:25:22.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7197e005-4815-4c91-aa54-5dabc5d62358 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104102024-12-18T22:25:22.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7197e005-4815-4c91-aa54-5dabc5d62358 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104112024-12-18T22:25:23.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2924d223-7eeb-4fcb-880a-cac37155a3ea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104122024-12-18T22:25:23.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2924d223-7eeb-4fcb-880a-cac37155a3ea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104132024-12-18T22:25:23.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2924d223-7eeb-4fcb-880a-cac37155a3ea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104142024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
104152024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
104162024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104172024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104182024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104192024-12-18T22:25:23.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104202024-12-18T22:25:23.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104212024-12-18T22:25:23.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104222024-12-18T22:25:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104232024-12-18T22:25:23.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.199052ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104242024-12-18T22:25:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104252024-12-18T22:25:23.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104262024-12-18T22:25:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104272024-12-18T22:25:23.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104282024-12-18T22:25:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104292024-12-18T22:25:23.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104302024-12-18T22:25:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
104312024-12-18T22:25:23.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104322024-12-18T22:25:23.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104332024-12-18T22:25:23.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
104342024-12-18T22:25:23.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.580185ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
104352024-12-18T22:25:24.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082cd424-9648-40dc-b4c4-cc997b81962b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104362024-12-18T22:25:24.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082cd424-9648-40dc-b4c4-cc997b81962b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104372024-12-18T22:25:24.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 082cd424-9648-40dc-b4c4-cc997b81962b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104382024-12-18T22:25:25.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 29c5be6a-e8ae-486c-a79a-d11a11bdcfea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104392024-12-18T22:25:25.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 29c5be6a-e8ae-486c-a79a-d11a11bdcfea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104402024-12-18T22:25:25.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 29c5be6a-e8ae-486c-a79a-d11a11bdcfea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104412024-12-18T22:25:26.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 29489fa9-13cc-4f71-b9ae-9d14817b0f22 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
104422024-12-18T22:25:26.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = cea6522c-7dff-45ee-8539-5f161fdc264e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
104432024-12-18T22:25:26.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = cea6522c-7dff-45ee-8539-5f161fdc264e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
104442024-12-18T22:25:26.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = cea6522c-7dff-45ee-8539-5f161fdc264e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
104452024-12-18T22:25:26.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a06fa02a-3c93-412e-841d-8958708fe7b8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104462024-12-18T22:25:26.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a06fa02a-3c93-412e-841d-8958708fe7b8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104472024-12-18T22:25:26.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c6e65232-5604-4808-a47d-f4b30ad316f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
104482024-12-18T22:25:26.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c6e65232-5604-4808-a47d-f4b30ad316f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
104492024-12-18T22:25:26.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a06fa02a-3c93-412e-841d-8958708fe7b8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104502024-12-18T22:25:26.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c6e65232-5604-4808-a47d-f4b30ad316f1 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
104512024-12-18T22:25:27.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2348cdb4-785b-4824-a268-47c4e6a3f944 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104522024-12-18T22:25:27.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2348cdb4-785b-4824-a268-47c4e6a3f944 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104532024-12-18T22:25:27.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2348cdb4-785b-4824-a268-47c4e6a3f944 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104542024-12-18T22:25:28.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d9ecfe4-fd5a-4afe-8323-c8422ac83e79 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104552024-12-18T22:25:28.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d9ecfe4-fd5a-4afe-8323-c8422ac83e79 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104562024-12-18T22:25:28.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1d9ecfe4-fd5a-4afe-8323-c8422ac83e79 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104572024-12-18T22:25:29.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c07b5f-5d27-4a03-8e25-d2f9afcae8a0 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104582024-12-18T22:25:29.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c07b5f-5d27-4a03-8e25-d2f9afcae8a0 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104592024-12-18T22:25:29.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c07b5f-5d27-4a03-8e25-d2f9afcae8a0 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104602024-12-18T22:25:30.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4b71f63-b73e-44ad-a5dd-0056264e1155 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104612024-12-18T22:25:30.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4b71f63-b73e-44ad-a5dd-0056264e1155 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104622024-12-18T22:25:30.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d4b71f63-b73e-44ad-a5dd-0056264e1155 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104632024-12-18T22:25:31.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c857aa53-22a2-4ff6-a6a9-a5e2a0a12560 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104642024-12-18T22:25:31.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c857aa53-22a2-4ff6-a6a9-a5e2a0a12560 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104652024-12-18T22:25:31.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c857aa53-22a2-4ff6-a6a9-a5e2a0a12560 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104662024-12-18T22:25:32.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c995fc27-a5bf-4895-b509-dc2785ade888 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104672024-12-18T22:25:32.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c995fc27-a5bf-4895-b509-dc2785ade888 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104682024-12-18T22:25:32.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c995fc27-a5bf-4895-b509-dc2785ade888 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104692024-12-18T22:25:33.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
104702024-12-18T22:25:33.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
104712024-12-18T22:25:33.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104722024-12-18T22:25:33.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104732024-12-18T22:25:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104742024-12-18T22:25:33.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104752024-12-18T22:25:33.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104762024-12-18T22:25:33.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104772024-12-18T22:25:33.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104782024-12-18T22:25:33.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.10464ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104792024-12-18T22:25:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104802024-12-18T22:25:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104812024-12-18T22:25:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104822024-12-18T22:25:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104832024-12-18T22:25:33.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104842024-12-18T22:25:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104852024-12-18T22:25:33.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
104862024-12-18T22:25:33.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104872024-12-18T22:25:33.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104882024-12-18T22:25:33.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
104892024-12-18T22:25:33.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.089143ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
104902024-12-18T22:25:33.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85903e2e-a4fd-4891-ad4e-51b945db358f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104912024-12-18T22:25:33.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85903e2e-a4fd-4891-ad4e-51b945db358f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104922024-12-18T22:25:33.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 85903e2e-a4fd-4891-ad4e-51b945db358f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
104932024-12-18T22:25:34.916ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5644e5fa-7605-4020-892a-d646fd342d84 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T22:25:34.889376071Z }
104942024-12-18T22:25:34.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5644e5fa-7605-4020-892a-d646fd342d84 roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
104952024-12-18T22:25:34.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5644e5fa-7605-4020-892a-d646fd342d84 resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
104962024-12-18T22:25:34.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66820 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5644e5fa-7605-4020-892a-d646fd342d84 response_code = 204 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
104972024-12-18T22:25:34.957ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d765b60-8150-47f4-902c-46d8b62fbe89 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T22:25:34.957505808Z }
104982024-12-18T22:25:34.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d765b60-8150-47f4-902c-46d8b62fbe89 roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
104992024-12-18T22:25:34.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d765b60-8150-47f4-902c-46d8b62fbe89 resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
105002024-12-18T22:25:34.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24507 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d765b60-8150-47f4-902c-46d8b62fbe89 response_code = 204 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
105012024-12-18T22:25:35.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 547bc18b-5b31-4cb2-90e9-fe4db026eb25 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105022024-12-18T22:25:35.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 547bc18b-5b31-4cb2-90e9-fe4db026eb25 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105032024-12-18T22:25:36.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 547bc18b-5b31-4cb2-90e9-fe4db026eb25 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105042024-12-18T22:25:36.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = f076fb49-73c1-4bb2-96dc-c214eef50de2 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
105052024-12-18T22:25:37.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df52adc5-85b2-46e3-970f-033d3129b9c8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105062024-12-18T22:25:37.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df52adc5-85b2-46e3-970f-033d3129b9c8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105072024-12-18T22:25:37.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df52adc5-85b2-46e3-970f-033d3129b9c8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105082024-12-18T22:25:38.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = beaacbb3-a409-4ebb-92f0-707c5152eeae roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105092024-12-18T22:25:38.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = beaacbb3-a409-4ebb-92f0-707c5152eeae resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105102024-12-18T22:25:38.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = beaacbb3-a409-4ebb-92f0-707c5152eeae response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105112024-12-18T22:25:39.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1825dc3-bf7e-46eb-b730-d05c5a689269 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105122024-12-18T22:25:39.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1825dc3-bf7e-46eb-b730-d05c5a689269 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105132024-12-18T22:25:39.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1825dc3-bf7e-46eb-b730-d05c5a689269 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105142024-12-18T22:25:40.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0d629b0-e73f-4bf2-8202-9c7731aff464 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105152024-12-18T22:25:40.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0d629b0-e73f-4bf2-8202-9c7731aff464 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105162024-12-18T22:25:40.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0d629b0-e73f-4bf2-8202-9c7731aff464 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105172024-12-18T22:25:41.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0ea3abc2-8dad-40eb-9c33-3b9dff8c647a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105182024-12-18T22:25:41.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0ea3abc2-8dad-40eb-9c33-3b9dff8c647a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105192024-12-18T22:25:41.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 0ea3abc2-8dad-40eb-9c33-3b9dff8c647a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105202024-12-18T22:25:42.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15cb5a0c-2b2d-4953-9ad5-1f913489121e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105212024-12-18T22:25:42.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15cb5a0c-2b2d-4953-9ad5-1f913489121e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105222024-12-18T22:25:42.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 15cb5a0c-2b2d-4953-9ad5-1f913489121e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105232024-12-18T22:25:43.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3d8d04f-5a75-47f4-876c-5c35e67b4b3b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105242024-12-18T22:25:43.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3d8d04f-5a75-47f4-876c-5c35e67b4b3b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105252024-12-18T22:25:43.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3d8d04f-5a75-47f4-876c-5c35e67b4b3b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
105262024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
105272024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
105282024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105292024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
105302024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105312024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105322024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105332024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
105342024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105352024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
105362024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
105372024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105382024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
105392024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105402024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105412024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
105422024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
105432024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105442024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
105452024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105462024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
105472024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
105482024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105492024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105502024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
105512024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105522024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
105532024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
105542024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105552024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105562024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
105572024-12-18T22:25:43.797ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105582024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105592024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
105602024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105612024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105622024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105632024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105642024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105652024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105662024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105672024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105682024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105692024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105702024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105712024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105722024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105732024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105742024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105752024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105762024-12-18T22:25:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105772024-12-18T22:25:43.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105782024-12-18T22:25:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.216523ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105792024-12-18T22:25:43.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105802024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105812024-12-18T22:25:43.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105822024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105832024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105842024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105852024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105862024-12-18T22:25:43.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105872024-12-18T22:25:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105882024-12-18T22:25:43.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105892024-12-18T22:25:43.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105902024-12-18T22:25:43.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.628369ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
105912024-12-18T22:25:43.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 424578950 } })
105922024-12-18T22:25:43.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105932024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105942024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105952024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105962024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105972024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105982024-12-18T22:25:43.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105992024-12-18T22:25:43.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.572597ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
106002024-12-18T22:25:43.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106012024-12-18T22:25:43.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106022024-12-18T22:25:43.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106032024-12-18T22:25:43.811ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106042024-12-18T22:25:43.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 430007606 } })
106052024-12-18T22:25:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106062024-12-18T22:25:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106072024-12-18T22:25:43.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106082024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106092024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106102024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106112024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106122024-12-18T22:25:43.813ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106132024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106142024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106152024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106162024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106172024-12-18T22:25:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106182024-12-18T22:25:43.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106192024-12-18T22:25:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106202024-12-18T22:25:43.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 433718889 } })
106212024-12-18T22:25:43.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
106222024-12-18T22:25:43.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.095275ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106232024-12-18T22:25:43.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106242024-12-18T22:25:43.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106252024-12-18T22:25:43.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106262024-12-18T22:25:43.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106272024-12-18T22:25:43.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106282024-12-18T22:25:43.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106292024-12-18T22:25:43.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106302024-12-18T22:25:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106312024-12-18T22:25:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
106322024-12-18T22:25:43.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106332024-12-18T22:25:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106342024-12-18T22:25:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106352024-12-18T22:25:43.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106362024-12-18T22:25:43.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106372024-12-18T22:25:43.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106382024-12-18T22:25:43.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106392024-12-18T22:25:43.826ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106402024-12-18T22:25:43.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106412024-12-18T22:25:43.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106422024-12-18T22:25:43.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106432024-12-18T22:25:43.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106442024-12-18T22:25:43.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106452024-12-18T22:25:43.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106462024-12-18T22:25:43.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106472024-12-18T22:25:43.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106482024-12-18T22:25:43.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106492024-12-18T22:25:43.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106502024-12-18T22:25:43.835ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
106512024-12-18T22:25:43.835ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.953985ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
106522024-12-18T22:25:43.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106532024-12-18T22:25:43.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106542024-12-18T22:25:43.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106552024-12-18T22:25:43.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106562024-12-18T22:25:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106572024-12-18T22:25:43.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.80171ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106582024-12-18T22:25:43.846ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106592024-12-18T22:25:43.846ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106602024-12-18T22:25:43.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 49.794197ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106612024-12-18T22:25:43.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106622024-12-18T22:25:43.906ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106632024-12-18T22:25:43.907ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff0a4ecd-821e-4796-8795-a0cacd5081b2", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
106642024-12-18T22:25:43.907ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106652024-12-18T22:25:43.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106662024-12-18T22:25:43.915ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.528516ms iteration = 27 status = {"physical_disks_added":0}
106672024-12-18T22:25:43.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106682024-12-18T22:25:43.919ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106692024-12-18T22:25:43.919ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af3e704e-74b1-40c0-a987-deb8088ee154", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
106702024-12-18T22:25:43.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106712024-12-18T22:25:43.921ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106722024-12-18T22:25:43.954ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106732024-12-18T22:25:43.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106742024-12-18T22:25:43.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5340eea-540b-4219-adcf-d445a98685ed", "content-length": "583", "date": "Wed, 18 Dec 2024 22:25:42 GMT"} })
106752024-12-18T22:25:43.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106762024-12-18T22:25:43.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106772024-12-18T22:25:43.957ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state
106782024-12-18T22:25:43.958ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8a4b64c-f089-42cf-ba84-b12ee6abc47c", "content-length": "130", "date": "Wed, 18 Dec 2024 22:25:42 GMT"} })
106792024-12-18T22:25:43.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106802024-12-18T22:25:43.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106812024-12-18T22:25:43.967ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T22:25:34.957505808Z }, migration_in: None, migration_out: None } vmm_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
106822024-12-18T22:25:43.967ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 vmm_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T22:25:34.957505808Z }
106832024-12-18T22:25:43.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 roles = RoleSet { roles: {} } sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 vmm_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
106842024-12-18T22:25:43.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 resource = Database result = Ok(()) sled_id = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 vmm_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
106852024-12-18T22:25:43.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106862024-12-18T22:25:43.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106872024-12-18T22:25:43.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 190.207372ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106882024-12-18T22:25:43.997ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
106892024-12-18T22:25:43.997ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106902024-12-18T22:25:43.997ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aa438db-492e-43aa-93a2-114540f5137d", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
106912024-12-18T22:25:43.997ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106922024-12-18T22:25:43.998ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
106932024-12-18T22:25:44.047ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.651818ms iteration = 24 status = {}
106942024-12-18T22:25:44.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106952024-12-18T22:25:44.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "792ec27d-07b4-4e2b-bbd3-93cd69dcc6c8", "content-length": "1", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
106962024-12-18T22:25:44.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106972024-12-18T22:25:44.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "db3da2b8-abd6-4a56-a3d9-09c25ee37b4d", "content-length": "810", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
106982024-12-18T22:25:44.050ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(4492759) }} sled = buskin
106992024-12-18T22:25:44.050ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
107002024-12-18T22:25:44.050ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
107012024-12-18T22:25:44.050ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107022024-12-18T22:25:44.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107032024-12-18T22:25:44.052ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 255.466993ms iteration = 24 status = {}
107042024-12-18T22:25:44.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 256.459272ms iteration = 24 status = null
107052024-12-18T22:25:44.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107062024-12-18T22:25:44.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107072024-12-18T22:25:44.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107082024-12-18T22:25:44.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107092024-12-18T22:25:44.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 283.048763ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
107102024-12-18T22:25:44.084ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
107112024-12-18T22:25:44.086ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 288.94601ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
107122024-12-18T22:25:44.088ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {c0b27ea6-4800-45ac-a9d3-91c04e2d8f33: {10.151.1.176: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}, 10.151.1.175: {8369c734-9ef6-4b82-9d5f-140f0929f1cf}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
107132024-12-18T22:25:44.088ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107142024-12-18T22:25:44.088ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "83fd12f1-6d04-4e5f-b8c5-42e8df6a8fd3", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
107152024-12-18T22:25:44.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107162024-12-18T22:25:44.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107172024-12-18T22:25:44.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107182024-12-18T22:25:44.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107192024-12-18T22:25:44.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107202024-12-18T22:25:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107212024-12-18T22:25:44.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107222024-12-18T22:25:44.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107232024-12-18T22:25:44.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107242024-12-18T22:25:44.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107252024-12-18T22:25:44.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107262024-12-18T22:25:44.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107272024-12-18T22:25:44.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107282024-12-18T22:25:44.103ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107292024-12-18T22:25:44.103ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107302024-12-18T22:25:44.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107312024-12-18T22:25:44.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d4d02985-ad34-4cfb-8aa8-46b9b5ab29c5", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
107322024-12-18T22:25:44.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
107332024-12-18T22:25:44.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107342024-12-18T22:25:44.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107352024-12-18T22:25:44.105ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.090824ms iteration = 24 status = {}
107362024-12-18T22:25:44.107ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 309.8729ms iteration = 24 status = 0
107372024-12-18T22:25:44.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107382024-12-18T22:25:44.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107392024-12-18T22:25:44.126ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
107402024-12-18T22:25:44.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107412024-12-18T22:25:44.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107422024-12-18T22:25:44.134ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107432024-12-18T22:25:44.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d384dfc-17f7-4c66-9540-0a726210a9bf", "content-length": "134", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
107442024-12-18T22:25:44.134ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107452024-12-18T22:25:44.134ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
107462024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107472024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107482024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107492024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107502024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107512024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107522024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107532024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107542024-12-18T22:25:44.135ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
107552024-12-18T22:25:44.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107562024-12-18T22:25:44.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107572024-12-18T22:25:44.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107582024-12-18T22:25:44.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d82dda80-ba1f-4d88-9ad0-ef513aa32dec", "content-length": "2", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
107592024-12-18T22:25:44.137ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107602024-12-18T22:25:44.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7a60451-0905-4a70-88c8-5cafbdcf5945", "content-length": "52", "date": "Wed, 18 Dec 2024 22:25:43 GMT"} })
107612024-12-18T22:25:44.137ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
107622024-12-18T22:25:44.137ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107632024-12-18T22:25:44.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "689139e7-6b4e-4f90-b5b5-26e2665487b8", "date": "Wed, 18 Dec 2024 22:25:44 GMT"} })
107642024-12-18T22:25:44.231ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
107652024-12-18T22:25:44.231ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107662024-12-18T22:25:44.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 344615bc-b16c-41ae-b5be-2ead8fda595d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107672024-12-18T22:25:44.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 344615bc-b16c-41ae-b5be-2ead8fda595d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107682024-12-18T22:25:44.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e02190ab-5002-4202-a3d6-a3e524945c07", "content-length": "682", "date": "Wed, 18 Dec 2024 22:25:44 GMT"} })
107692024-12-18T22:25:44.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107702024-12-18T22:25:44.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107712024-12-18T22:25:44.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 344615bc-b16c-41ae-b5be-2ead8fda595d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107722024-12-18T22:25:44.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107732024-12-18T22:25:44.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107742024-12-18T22:25:44.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107752024-12-18T22:25:44.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107762024-12-18T22:25:44.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107772024-12-18T22:25:44.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107782024-12-18T22:25:44.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 451.391986ms iteration = 24 status = {}
107792024-12-18T22:25:44.721ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b164ab07-f71d-4235-897e-eddf7cf73e22 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T22:25:44.721499046Z }
107802024-12-18T22:25:44.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b164ab07-f71d-4235-897e-eddf7cf73e22 roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
107812024-12-18T22:25:44.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b164ab07-f71d-4235-897e-eddf7cf73e22 resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
107822024-12-18T22:25:44.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39829 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b164ab07-f71d-4235-897e-eddf7cf73e22 response_code = 204 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
107832024-12-18T22:25:45.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a22ee0b7-4197-4871-b957-4931123bf724 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107842024-12-18T22:25:45.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a22ee0b7-4197-4871-b957-4931123bf724 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107852024-12-18T22:25:45.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a22ee0b7-4197-4871-b957-4931123bf724 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107862024-12-18T22:25:45.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c254f4a2-3081-4611-a58d-c77f68a5f7d6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
107872024-12-18T22:25:45.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c254f4a2-3081-4611-a58d-c77f68a5f7d6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
107882024-12-18T22:25:45.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = c254f4a2-3081-4611-a58d-c77f68a5f7d6 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
107892024-12-18T22:25:45.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 4a19274e-f756-466f-b030-498089b48102 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
107902024-12-18T22:25:45.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 4a19274e-f756-466f-b030-498089b48102 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
107912024-12-18T22:25:45.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 4a19274e-f756-466f-b030-498089b48102 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
107922024-12-18T22:25:46.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe8568d2-a654-4e46-935e-112ce56101d8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107932024-12-18T22:25:46.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe8568d2-a654-4e46-935e-112ce56101d8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107942024-12-18T22:25:46.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe8568d2-a654-4e46-935e-112ce56101d8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
107952024-12-18T22:25:46.638ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3205 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = dcb2a221-079f-407b-9dec-09a1f8689b90 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
107962024-12-18T22:25:46.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d23ffb6e-dd93-4819-a58f-6faae1587835 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
107972024-12-18T22:25:46.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d23ffb6e-dd93-4819-a58f-6faae1587835 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
107982024-12-18T22:25:46.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = d23ffb6e-dd93-4819-a58f-6faae1587835 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
107992024-12-18T22:25:47.196ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T22:25:47.196381843Z }
108002024-12-18T22:25:47.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108012024-12-18T22:25:47.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108022024-12-18T22:25:47.240ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_needs_update = true
108032024-12-18T22:25:47.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108042024-12-18T22:25:47.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108052024-12-18T22:25:47.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108062024-12-18T22:25:47.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108072024-12-18T22:25:47.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108082024-12-18T22:25:47.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108092024-12-18T22:25:47.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108102024-12-18T22:25:47.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108112024-12-18T22:25:47.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108122024-12-18T22:25:47.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108132024-12-18T22:25:47.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108142024-12-18T22:25:47.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108152024-12-18T22:25:47.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108162024-12-18T22:25:47.288ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 76b3a5a9-e9ba-496d-bfb7-72898689a859, lookup_type: ById(76b3a5a9-e9ba-496d-bfb7-72898689a859) }, key: e61455aa-73bb-4c25-99fb-db083d755787, lookup_type: ById(e61455aa-73bb-4c25-99fb-db083d755787) }, key: 861b1718-78dd-4ee4-9019-f03d9609c535, lookup_type: ById(861b1718-78dd-4ee4-9019-f03d9609c535) } result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108172024-12-18T22:25:47.296ZINFOnexus (dropshot_internal): starting update saga for 861b1718-78dd-4ee4-9019-f03d9609c535 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T22:25:47.196381843Z }
108182024-12-18T22:25:47.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101684 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e response_code = 204 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108192024-12-18T22:25:47.298ZDEBGnexus (dropshot_internal): preparing instance-update saga for 861b1718-78dd-4ee4-9019-f03d9609c535... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 68998a77-9e84-4c3a-a6df-195f7752716e uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108202024-12-18T22:25:47.298ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update
108212024-12-18T22:25:47.298ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f48cb2b-7bf6-4549-af90-4c79f543e9b4 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T22:25:47.196381843Z }
108222024-12-18T22:25:47.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f48cb2b-7bf6-4549-af90-4c79f543e9b4 roles = RoleSet { roles: {} } uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108232024-12-18T22:25:47.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f48cb2b-7bf6-4549-af90-4c79f543e9b4 resource = Database result = Ok(()) uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108242024-12-18T22:25:47.300ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"861b1718-78dd-4ee4-9019-f03d9609c535","lookup_type":{"ById":"861b1718-78dd-4ee4-9019-f03d9609c535"},"parent":{"key":"e61455aa-73bb-4c25-99fb-db083d755787","lookup_type":{"ById":"e61455aa-73bb-4c25-99fb-db083d755787"},"parent":{"key":"76b3a5a9-e9ba-496d-bfb7-72898689a859","lookup_type":{"ById":"76b3a5a9-e9ba-496d-bfb7-72898689a859"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108252024-12-18T22:25:47.302ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update
108262024-12-18T22:25:47.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4735 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3f48cb2b-7bf6-4549-af90-4c79f543e9b4 response_code = 204 uri = /vmms/23cacdc9-61c5-437c-b8c1-d2c8e002a6eb
108272024-12-18T22:25:47.341ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update
108282024-12-18T22:25:47.341ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108292024-12-18T22:25:47.341ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108302024-12-18T22:25:47.343ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108312024-12-18T22:25:47.358ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108322024-12-18T22:25:47.358ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108332024-12-18T22:25:47.365ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108342024-12-18T22:25:47.365ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108352024-12-18T22:25:47.373ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108362024-12-18T22:25:47.373ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d5f3a163-9a0c-4025-a27c-a67e93b5396e")) node_id = 0 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108372024-12-18T22:25:47.380ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108382024-12-18T22:25:47.380ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108392024-12-18T22:25:47.396ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update
108402024-12-18T22:25:47.399ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108412024-12-18T22:25:47.399ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108422024-12-18T22:25:47.401ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108432024-12-18T22:25:47.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108442024-12-18T22:25:47.403ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108452024-12-18T22:25:47.403ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108462024-12-18T22:25:47.407ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108472024-12-18T22:25:47.407ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108482024-12-18T22:25:47.408ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108492024-12-18T22:25:47.409ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108502024-12-18T22:25:47.410ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108512024-12-18T22:25:47.410ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108522024-12-18T22:25:47.411ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108532024-12-18T22:25:47.414ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 76b3a5a9-e9ba-496d-bfb7-72898689a859, lookup_type: ById(76b3a5a9-e9ba-496d-bfb7-72898689a859) }, key: e61455aa-73bb-4c25-99fb-db083d755787, lookup_type: ById(e61455aa-73bb-4c25-99fb-db083d755787) }, key: 861b1718-78dd-4ee4-9019-f03d9609c535, lookup_type: ById(861b1718-78dd-4ee4-9019-f03d9609c535) } result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108542024-12-18T22:25:47.414ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance updater_id = d5f3a163-9a0c-4025-a27c-a67e93b5396e
108552024-12-18T22:25:47.414ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108562024-12-18T22:25:47.414ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108572024-12-18T22:25:47.434ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance updater_id = d5f3a163-9a0c-4025-a27c-a67e93b5396e
108582024-12-18T22:25:47.434ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108592024-12-18T22:25:47.435ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance
108602024-12-18T22:25:47.439ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 locked_gen = Generation(Generation(2)) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = LockInstance updater_id = d5f3a163-9a0c-4025-a27c-a67e93b5396e
108612024-12-18T22:25:47.441ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108622024-12-18T22:25:47.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d5f3a163-9a0c-4025-a27c-a67e93b5396e")}) node_id = 1 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108632024-12-18T22:25:47.445ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108642024-12-18T22:25:47.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
108652024-12-18T22:25:47.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108662024-12-18T22:25:47.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108672024-12-18T22:25:47.459ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108682024-12-18T22:25:47.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108692024-12-18T22:25:47.461ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108702024-12-18T22:25:47.461ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108712024-12-18T22:25:47.463ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108722024-12-18T22:25:47.465ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 76b3a5a9-e9ba-496d-bfb7-72898689a859, lookup_type: ById(76b3a5a9-e9ba-496d-bfb7-72898689a859) }, key: e61455aa-73bb-4c25-99fb-db083d755787, lookup_type: ById(e61455aa-73bb-4c25-99fb-db083d755787) }, key: 861b1718-78dd-4ee4-9019-f03d9609c535, lookup_type: ById(861b1718-78dd-4ee4-9019-f03d9609c535) } result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108732024-12-18T22:25:47.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108742024-12-18T22:25:47.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
108752024-12-18T22:25:47.471ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb, time_created: 2024-12-18T22:25:25.948783Z, time_deleted: None, instance_id: 861b1718-78dd-4ee4-9019-f03d9609c535, sled_id: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-18T22:25:47.196381Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-18T22:25:21.646377Z, gen: Generation(Generation(3)), propolis_id: Some(23cacdc9-61c5-437c-b8c1-d2c8e002a6eb), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(23cacdc9-61c5-437c-b8c1-d2c8e002a6eb (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-18T22:25:47.471696764Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
108762024-12-18T22:25:47.471ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
108772024-12-18T22:25:47.471ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"861b1718-78dd-4ee4-9019-f03d9609c535","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"23cacdc9-61c5-437c-b8c1-d2c8e002a6eb"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"861b1718-78dd-4ee4-9019-f03d9609c535","lookup_type":{"ById":"861b1718-78dd-4ee4-9019-f03d9609c535"},"parent":{"key":"e61455aa-73bb-4c25-99fb-db083d755787","lookup_type":{"ById":"e61455aa-73bb-4c25-99fb-db083d755787"},"parent":{"key":"76b3a5a9-e9ba-496d-bfb7-72898689a859","lookup_type":{"ById":"76b3a5a9-e9ba-496d-bfb7-72898689a859"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d5f3a163-9a0c-4025-a27c-a67e93b5396e"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"e61455aa-73bb-4c25-99fb-db083d755787","ram_diff":1073741824},"destroy_active_vmm":"23cacdc9-61c5-437c-b8c1-d2c8e002a6eb","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-18T22:25:47.471696764Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108782024-12-18T22:25:47.471ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
108792024-12-18T22:25:47.477ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
108802024-12-18T22:25:47.477ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108812024-12-18T22:25:47.477ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108822024-12-18T22:25:47.477ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108832024-12-18T22:25:47.484ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108842024-12-18T22:25:47.484ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108852024-12-18T22:25:47.488ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108862024-12-18T22:25:47.488ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108872024-12-18T22:25:47.495ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108882024-12-18T22:25:47.495ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("03e79b4d-f227-4812-8c77-e07c96891353")) node_id = 0 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108892024-12-18T22:25:47.502ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108902024-12-18T22:25:47.502ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108912024-12-18T22:25:47.507ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 parent_lock = UpdaterLock { updater_id: d5f3a163-9a0c-4025-a27c-a67e93b5396e, locked_gen: Generation(Generation(2)) } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
108922024-12-18T22:25:47.507ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = BecomeUpdater
108932024-12-18T22:25:47.507ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = BecomeUpdater
108942024-12-18T22:25:47.523ZDEBGnexus (SagaExecutor): inherited lock from d5f3a163-9a0c-4025-a27c-a67e93b5396e to 03e79b4d-f227-4812-8c77-e07c96891353 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d5f3a163-9a0c-4025-a27c-a67e93b5396e saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = BecomeUpdater updater_id = 03e79b4d-f227-4812-8c77-e07c96891353
108952024-12-18T22:25:47.526ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
108962024-12-18T22:25:47.528ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108972024-12-18T22:25:47.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("03e79b4d-f227-4812-8c77-e07c96891353")}) node_id = 1 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
108982024-12-18T22:25:47.532ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
108992024-12-18T22:25:47.532ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109002024-12-18T22:25:47.537ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109012024-12-18T22:25:47.537ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109022024-12-18T22:25:47.543ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109032024-12-18T22:25:47.543ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109042024-12-18T22:25:47.554ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109052024-12-18T22:25:47.560ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535
109062024-12-18T22:25:47.560ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109072024-12-18T22:25:47.561ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109082024-12-18T22:25:47.565ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109092024-12-18T22:25:47.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109102024-12-18T22:25:47.567ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
109112024-12-18T22:25:47.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109122024-12-18T22:25:47.568ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UpdateNetworkConfig
109132024-12-18T22:25:47.570ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
109142024-12-18T22:25:47.570ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
109152024-12-18T22:25:47.570ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
109162024-12-18T22:25:47.571ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
109172024-12-18T22:25:47.573ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
109182024-12-18T22:25:47.573ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
109192024-12-18T22:25:47.573ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
109202024-12-18T22:25:47.577ZDEBGnexus: notifying dendrite of updates instance_id = Some(861b1718-78dd-4ee4-9019-f03d9609c535 (instance)) switch = switch0
109212024-12-18T22:25:47.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1638, tv_nsec: 195873813 } })
109222024-12-18T22:25:47.578ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
109232024-12-18T22:25:47.608ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109242024-12-18T22:25:47.608ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109252024-12-18T22:25:47.608ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd1416e-532c-415f-bd99-0d791d8f3a3d", "content-length": "26", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
109262024-12-18T22:25:47.608ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109272024-12-18T22:25:47.609ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109282024-12-18T22:25:47.639ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
109292024-12-18T22:25:47.639ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dadd37b-fbb3-4b9c-bef6-46c042b824b5", "content-length": "4", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
109302024-12-18T22:25:47.641ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109312024-12-18T22:25:47.641ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109322024-12-18T22:25:47.647ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109332024-12-18T22:25:47.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109342024-12-18T22:25:47.654ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ReleaseVirtualProvisioning
109352024-12-18T22:25:47.654ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ReleaseVirtualProvisioning
109362024-12-18T22:25:47.673ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-18T22:25:47.659494Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, time_modified: Some(2024-12-18T22:25:47.659494Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e61455aa-73bb-4c25-99fb-db083d755787, time_modified: Some(2024-12-18T22:25:47.659494Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109372024-12-18T22:25:47.673ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109382024-12-18T22:25:47.673ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109392024-12-18T22:25:47.683ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109402024-12-18T22:25:47.683ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109412024-12-18T22:25:47.693ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109422024-12-18T22:25:47.693ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UnassignOximeterProducer
109432024-12-18T22:25:47.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UnassignOximeterProducer
109442024-12-18T22:25:47.700ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 producer_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109452024-12-18T22:25:47.700ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UnassignOximeterProducer
109462024-12-18T22:25:47.700ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = UnassignOximeterProducer
109472024-12-18T22:25:47.735ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109482024-12-18T22:25:47.737ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/861b1718-78dd-4ee4-9019-f03d9609c535
109492024-12-18T22:25:47.749ZDEBGnexus (SagaExecutor): client response oximeter-collector = 861b1718-78dd-4ee4-9019-f03d9609c535 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/861b1718-78dd-4ee4-9019-f03d9609c535", status: 204, headers: {"x-request-id": "3ac2e517-0e5b-41aa-963d-e406fc31e053", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} }) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109502024-12-18T22:25:47.749ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 producer_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109512024-12-18T22:25:47.751ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109522024-12-18T22:25:47.751ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109532024-12-18T22:25:47.758ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109542024-12-18T22:25:47.758ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109552024-12-18T22:25:47.762ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 lock = UpdaterLock { updater_id: 03e79b4d-f227-4812-8c77-e07c96891353, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-18T22:25:47.471696764Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109562024-12-18T22:25:47.762ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = CommitInstanceUpdates
109572024-12-18T22:25:47.762ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = CommitInstanceUpdates
109582024-12-18T22:25:47.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f6109d66-0153-4231-977e-344db4ce5a5e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
109592024-12-18T22:25:47.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f6109d66-0153-4231-977e-344db4ce5a5e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
109602024-12-18T22:25:47.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = f6109d66-0153-4231-977e-344db4ce5a5e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
109612024-12-18T22:25:47.813ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 new_runtime = InstanceRuntimeState { time_updated: 2024-12-18T22:25:47.471696764Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109622024-12-18T22:25:47.813ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109632024-12-18T22:25:47.813ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109642024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
109652024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
109662024-12-18T22:25:47.813ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109672024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109682024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109692024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109702024-12-18T22:25:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109712024-12-18T22:25:47.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109722024-12-18T22:25:47.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109732024-12-18T22:25:47.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109742024-12-18T22:25:47.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109752024-12-18T22:25:47.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109762024-12-18T22:25:47.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109772024-12-18T22:25:47.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109782024-12-18T22:25:47.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109792024-12-18T22:25:47.819ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109802024-12-18T22:25:47.819ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109812024-12-18T22:25:47.825ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109822024-12-18T22:25:47.825ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("861b1718-78dd-4ee4-9019-f03d9609c535"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("23cacdc9-61c5-437c-b8c1-d2c8e002a6eb")}) node_id = 7 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109832024-12-18T22:25:47.836ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109842024-12-18T22:25:47.836ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109852024-12-18T22:25:47.842ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109862024-12-18T22:25:47.842ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109872024-12-18T22:25:47.845ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109882024-12-18T22:25:47.845ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109892024-12-18T22:25:47.855ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109902024-12-18T22:25:47.855ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ReleaseSledResources
109912024-12-18T22:25:47.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ReleaseSledResources
109922024-12-18T22:25:47.878ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109932024-12-18T22:25:47.878ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109942024-12-18T22:25:47.885ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
109952024-12-18T22:25:47.885ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
109962024-12-18T22:25:47.894ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 propolis_id = 23cacdc9-61c5-437c-b8c1-d2c8e002a6eb saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
109972024-12-18T22:25:47.894ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = MarkVmmDeleted
109982024-12-18T22:25:47.894ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = MarkVmmDeleted
109992024-12-18T22:25:47.911ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110002024-12-18T22:25:47.911ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110012024-12-18T22:25:47.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eabd8f9-c547-4946-af97-9ca74e8829e0", "content-length": "372", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
110022024-12-18T22:25:47.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110032024-12-18T22:25:47.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110042024-12-18T22:25:47.914ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110052024-12-18T22:25:47.914ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110062024-12-18T22:25:47.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110072024-12-18T22:25:47.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110082024-12-18T22:25:47.921ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110092024-12-18T22:25:47.921ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110102024-12-18T22:25:47.929ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110112024-12-18T22:25:47.929ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110122024-12-18T22:25:47.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110132024-12-18T22:25:47.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110142024-12-18T22:25:47.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110152024-12-18T22:25:47.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110162024-12-18T22:25:47.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110172024-12-18T22:25:47.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110182024-12-18T22:25:47.934ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110192024-12-18T22:25:47.934ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110202024-12-18T22:25:47.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110212024-12-18T22:25:47.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110222024-12-18T22:25:47.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110232024-12-18T22:25:47.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110242024-12-18T22:25:47.944ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110252024-12-18T22:25:47.944ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110262024-12-18T22:25:47.946ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110272024-12-18T22:25:47.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110282024-12-18T22:25:47.948ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110292024-12-18T22:25:47.948ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110302024-12-18T22:25:47.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110312024-12-18T22:25:47.953ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 76b3a5a9-e9ba-496d-bfb7-72898689a859, lookup_type: ById(76b3a5a9-e9ba-496d-bfb7-72898689a859) }, key: e61455aa-73bb-4c25-99fb-db083d755787, lookup_type: ById(e61455aa-73bb-4c25-99fb-db083d755787) }, key: 861b1718-78dd-4ee4-9019-f03d9609c535, lookup_type: ById(861b1718-78dd-4ee4-9019-f03d9609c535) } result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110322024-12-18T22:25:47.953ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110332024-12-18T22:25:47.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_node = ChainSuccessorSaga
110342024-12-18T22:25:47.958ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update
110352024-12-18T22:25:47.958ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110362024-12-18T22:25:47.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110372024-12-18T22:25:47.958ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
110382024-12-18T22:25:47.958ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110392024-12-18T22:25:47.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110402024-12-18T22:25:47.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110412024-12-18T22:25:47.959ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
110422024-12-18T22:25:47.959ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110432024-12-18T22:25:47.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2dd7803c-7dd4-41c0-952e-eca2b6aaf337", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
110442024-12-18T22:25:47.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110452024-12-18T22:25:47.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110462024-12-18T22:25:47.960ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110472024-12-18T22:25:47.961ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110482024-12-18T22:25:47.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110492024-12-18T22:25:47.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110502024-12-18T22:25:47.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110512024-12-18T22:25:47.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110522024-12-18T22:25:47.963ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110532024-12-18T22:25:47.963ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110542024-12-18T22:25:47.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110552024-12-18T22:25:47.964ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110562024-12-18T22:25:47.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110572024-12-18T22:25:47.964ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110582024-12-18T22:25:47.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110592024-12-18T22:25:47.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110602024-12-18T22:25:47.968ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110612024-12-18T22:25:47.968ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110622024-12-18T22:25:47.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62199d18-d8e9-47b9-a4f1-a27b24cccb48", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
110632024-12-18T22:25:47.970ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 157.689774ms iteration = 25 status = {}
110642024-12-18T22:25:47.970ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110652024-12-18T22:25:47.970ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110662024-12-18T22:25:47.978ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110672024-12-18T22:25:47.978ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa
110682024-12-18T22:25:47.995ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110692024-12-18T22:25:47.995ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110702024-12-18T22:25:47.995ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 36.818893ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110712024-12-18T22:25:47.996ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110722024-12-18T22:25:47.996ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa saga_name = instance-update saga_result = SagaResult { saga_id: 7b9b85ce-786b-4f3e-8520-a0bc92130daa, saga_log: SagaLog { saga_id: 7b9b85ce-786b-4f3e-8520-a0bc92130daa, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("03e79b4d-f227-4812-8c77-e07c96891353")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("03e79b4d-f227-4812-8c77-e07c96891353")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("861b1718-78dd-4ee4-9019-f03d9609c535"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("23cacdc9-61c5-437c-b8c1-d2c8e002a6eb")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("861b1718-78dd-4ee4-9019-f03d9609c535"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("23cacdc9-61c5-437c-b8c1-d2c8e002a6eb")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("03e79b4d-f227-4812-8c77-e07c96891353"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("03e79b4d-f227-4812-8c77-e07c96891353")}} }) }
110732024-12-18T22:25:47.996ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 7b9b85ce-786b-4f3e-8520-a0bc92130daa instance_id = 861b1718-78dd-4ee4-9019-f03d9609c535 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update
110742024-12-18T22:25:47.996ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110752024-12-18T22:25:47.997ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
110762024-12-18T22:25:48.004ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110772024-12-18T22:25:48.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
110782024-12-18T22:25:48.011ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110792024-12-18T22:25:48.011ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
110802024-12-18T22:25:48.019ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110812024-12-18T22:25:48.019ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78
110822024-12-18T22:25:48.030ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110832024-12-18T22:25:48.030ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "15928868-ecd6-4200-9d82-4aab7d0a2e2b", "content-length": "691", "date": "Wed, 18 Dec 2024 22:25:47 GMT"} })
110842024-12-18T22:25:48.030ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110852024-12-18T22:25:48.030ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110862024-12-18T22:25:48.030ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110872024-12-18T22:25:48.033ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.910885ms iteration = 25 status = {}
110882024-12-18T22:25:48.033ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update sec_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
110892024-12-18T22:25:48.033ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2277caa4-5724-4bbc-b368-245e72ae9f78 saga_name = start-instance-update saga_result = SagaResult { saga_id: 2277caa4-5724-4bbc-b368-245e72ae9f78, saga_log: SagaLog { saga_id: 2277caa4-5724-4bbc-b368-245e72ae9f78, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d5f3a163-9a0c-4025-a27c-a67e93b5396e")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d5f3a163-9a0c-4025-a27c-a67e93b5396e")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d5f3a163-9a0c-4025-a27c-a67e93b5396e"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d5f3a163-9a0c-4025-a27c-a67e93b5396e")}} }) }
110902024-12-18T22:25:48.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cbdc8a5-87a2-4115-be9d-22e347548143 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110912024-12-18T22:25:48.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cbdc8a5-87a2-4115-be9d-22e347548143 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110922024-12-18T22:25:48.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2cbdc8a5-87a2-4115-be9d-22e347548143 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110932024-12-18T22:25:49.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d7c5865-abea-4de5-9e85-14489d5ffce2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110942024-12-18T22:25:49.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d7c5865-abea-4de5-9e85-14489d5ffce2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110952024-12-18T22:25:49.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8d7c5865-abea-4de5-9e85-14489d5ffce2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110962024-12-18T22:25:50.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37cbe200-a673-4d71-a81f-2e731bb3849e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110972024-12-18T22:25:50.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37cbe200-a673-4d71-a81f-2e731bb3849e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110982024-12-18T22:25:50.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 37cbe200-a673-4d71-a81f-2e731bb3849e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
110992024-12-18T22:25:51.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c09dd93-ad49-4220-9d9f-8338e4498d9c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111002024-12-18T22:25:51.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c09dd93-ad49-4220-9d9f-8338e4498d9c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111012024-12-18T22:25:51.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5c09dd93-ad49-4220-9d9f-8338e4498d9c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111022024-12-18T22:25:52.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d282609-222f-49f1-9414-253a1ca04e97 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111032024-12-18T22:25:52.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d282609-222f-49f1-9414-253a1ca04e97 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111042024-12-18T22:25:52.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d282609-222f-49f1-9414-253a1ca04e97 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111052024-12-18T22:25:53.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b14e86a-4044-4ec7-8a2a-d98a8884e03f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111062024-12-18T22:25:53.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b14e86a-4044-4ec7-8a2a-d98a8884e03f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111072024-12-18T22:25:53.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b14e86a-4044-4ec7-8a2a-d98a8884e03f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111082024-12-18T22:25:53.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
111092024-12-18T22:25:53.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
111102024-12-18T22:25:53.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111112024-12-18T22:25:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111122024-12-18T22:25:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111132024-12-18T22:25:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111142024-12-18T22:25:53.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111152024-12-18T22:25:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111162024-12-18T22:25:53.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111172024-12-18T22:25:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111182024-12-18T22:25:53.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111192024-12-18T22:25:53.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111202024-12-18T22:25:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111212024-12-18T22:25:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
111222024-12-18T22:25:53.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111232024-12-18T22:25:53.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111242024-12-18T22:25:53.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
111252024-12-18T22:25:53.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.621873ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
111262024-12-18T22:25:53.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111272024-12-18T22:25:53.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111282024-12-18T22:25:53.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.299342ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111292024-12-18T22:25:54.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c443cc-6452-4652-aa3b-572b2a72a6a1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111302024-12-18T22:25:54.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c443cc-6452-4652-aa3b-572b2a72a6a1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111312024-12-18T22:25:54.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a2c443cc-6452-4652-aa3b-572b2a72a6a1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111322024-12-18T22:25:55.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fdf58f95-dd0d-4fb2-9f8e-372d9097e243 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111332024-12-18T22:25:55.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fdf58f95-dd0d-4fb2-9f8e-372d9097e243 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111342024-12-18T22:25:55.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fdf58f95-dd0d-4fb2-9f8e-372d9097e243 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111352024-12-18T22:25:56.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec4b4b92-6c4d-4b46-87ad-aeadb7c2a0a4 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111362024-12-18T22:25:56.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec4b4b92-6c4d-4b46-87ad-aeadb7c2a0a4 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111372024-12-18T22:25:56.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ec4b4b92-6c4d-4b46-87ad-aeadb7c2a0a4 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111382024-12-18T22:25:56.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 708 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5b7c579f-39cb-4540-aa34-0b62bb03e8c0 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
111392024-12-18T22:25:57.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 570457c7-a495-43a8-a548-d913224e10fa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111402024-12-18T22:25:57.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 570457c7-a495-43a8-a548-d913224e10fa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111412024-12-18T22:25:57.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 570457c7-a495-43a8-a548-d913224e10fa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111422024-12-18T22:25:58.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b6ab1e-1f35-4c4a-92ff-81772915084c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111432024-12-18T22:25:58.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b6ab1e-1f35-4c4a-92ff-81772915084c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111442024-12-18T22:25:58.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 09b6ab1e-1f35-4c4a-92ff-81772915084c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111452024-12-18T22:25:59.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7afd11b-1965-4e7a-b47b-057859be2036 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111462024-12-18T22:25:59.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7afd11b-1965-4e7a-b47b-057859be2036 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111472024-12-18T22:25:59.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7afd11b-1965-4e7a-b47b-057859be2036 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111482024-12-18T22:26:00.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b3353b-24ff-4278-a4ec-3449d065a4b7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111492024-12-18T22:26:00.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b3353b-24ff-4278-a4ec-3449d065a4b7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111502024-12-18T22:26:00.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 13b3353b-24ff-4278-a4ec-3449d065a4b7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111512024-12-18T22:26:01.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 28225c2b-15fd-4a2b-9ed5-d4effdbc5ff9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111522024-12-18T22:26:01.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 28225c2b-15fd-4a2b-9ed5-d4effdbc5ff9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111532024-12-18T22:26:01.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 28225c2b-15fd-4a2b-9ed5-d4effdbc5ff9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111542024-12-18T22:26:02.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a9ade60-d2ed-4d66-ac2d-88e2dbbb233a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111552024-12-18T22:26:02.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a9ade60-d2ed-4d66-ac2d-88e2dbbb233a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111562024-12-18T22:26:02.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3a9ade60-d2ed-4d66-ac2d-88e2dbbb233a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111572024-12-18T22:26:03.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d66bf79d-a426-410b-8008-ba36cdf4f3b9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111582024-12-18T22:26:03.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d66bf79d-a426-410b-8008-ba36cdf4f3b9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111592024-12-18T22:26:03.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d66bf79d-a426-410b-8008-ba36cdf4f3b9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111602024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
111612024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
111622024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111632024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111642024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111652024-12-18T22:26:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111662024-12-18T22:26:03.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111672024-12-18T22:26:03.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111682024-12-18T22:26:03.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111692024-12-18T22:26:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111702024-12-18T22:26:03.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111712024-12-18T22:26:03.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111722024-12-18T22:26:03.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111732024-12-18T22:26:03.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
111742024-12-18T22:26:03.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111752024-12-18T22:26:03.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111762024-12-18T22:26:03.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
111772024-12-18T22:26:03.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.310379ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
111782024-12-18T22:26:03.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111792024-12-18T22:26:03.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111802024-12-18T22:26:03.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.339425ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111812024-12-18T22:26:04.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b8e437-0330-4c82-bc97-32c607554018 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111822024-12-18T22:26:04.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b8e437-0330-4c82-bc97-32c607554018 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111832024-12-18T22:26:04.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 70b8e437-0330-4c82-bc97-32c607554018 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111842024-12-18T22:26:05.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ad2a8f6-718c-480d-87f9-c3a1347bd2ea roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111852024-12-18T22:26:05.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ad2a8f6-718c-480d-87f9-c3a1347bd2ea resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111862024-12-18T22:26:05.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9ad2a8f6-718c-480d-87f9-c3a1347bd2ea response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111872024-12-18T22:26:06.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 696 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 0a2e663f-f748-47eb-9848-372721de9238 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
111882024-12-18T22:26:06.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc992ea3-1254-4d53-bda7-979d2d2881f7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111892024-12-18T22:26:06.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc992ea3-1254-4d53-bda7-979d2d2881f7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111902024-12-18T22:26:06.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc992ea3-1254-4d53-bda7-979d2d2881f7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111912024-12-18T22:26:07.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd3011f2-4d6b-4686-8303-8b5418364cae roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111922024-12-18T22:26:07.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd3011f2-4d6b-4686-8303-8b5418364cae resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111932024-12-18T22:26:07.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd3011f2-4d6b-4686-8303-8b5418364cae response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111942024-12-18T22:26:08.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d3085a6-97cd-4d52-b13f-235ebcf78caa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111952024-12-18T22:26:08.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d3085a6-97cd-4d52-b13f-235ebcf78caa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111962024-12-18T22:26:08.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2d3085a6-97cd-4d52-b13f-235ebcf78caa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111972024-12-18T22:26:09.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7f96803-2181-433f-a486-52fcec050f0e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111982024-12-18T22:26:09.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7f96803-2181-433f-a486-52fcec050f0e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
111992024-12-18T22:26:09.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d7f96803-2181-433f-a486-52fcec050f0e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112002024-12-18T22:26:10.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44cb1bc4-0997-4273-9bbf-ab22d790eb2f roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112012024-12-18T22:26:10.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44cb1bc4-0997-4273-9bbf-ab22d790eb2f resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112022024-12-18T22:26:10.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44cb1bc4-0997-4273-9bbf-ab22d790eb2f response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112032024-12-18T22:26:11.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e81df3d2-2623-42a6-87b1-0191470e6d18 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112042024-12-18T22:26:11.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e81df3d2-2623-42a6-87b1-0191470e6d18 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112052024-12-18T22:26:11.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e81df3d2-2623-42a6-87b1-0191470e6d18 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112062024-12-18T22:26:12.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3912a143-19d1-48ed-8c61-3221e49a97ee roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112072024-12-18T22:26:12.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3912a143-19d1-48ed-8c61-3221e49a97ee resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112082024-12-18T22:26:12.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3912a143-19d1-48ed-8c61-3221e49a97ee response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
112092024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
112102024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
112112024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112122024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112132024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
112142024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
112152024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
112162024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
112172024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112182024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
112192024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
112202024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112212024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
112222024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
112232024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
112242024-12-18T22:26:13.797ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:16:13.797817179 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
112252024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
112262024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
112272024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112282024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
112292024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
112302024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
112312024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
112322024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112332024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112342024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
112352024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
112362024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
112372024-12-18T22:26:13.797ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
112382024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.911\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
112392024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
112402024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112412024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
112422024-12-18T22:26:13.797ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
112432024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
112442024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112452024-12-18T22:26:13.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112462024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
112472024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
112482024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112492024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
112502024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
112512024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112522024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
112532024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
112542024-12-18T22:26:13.798ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112552024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
112562024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112572024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
112582024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112592024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
112602024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112612024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
112622024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
112632024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
112642024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
112652024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
112662024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
112672024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112682024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112692024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
112702024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112712024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112722024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112732024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112742024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112752024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
112762024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
112772024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112782024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112792024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112802024-12-18T22:26:13.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 416010752 } })
112812024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112822024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
112832024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
112842024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
112852024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112862024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112872024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112882024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112892024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
112902024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
112912024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112922024-12-18T22:26:13.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 416191825 } })
112932024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112942024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112952024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
112962024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112972024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112982024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112992024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113002024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113012024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
113022024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113032024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
113042024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.088091ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
113052024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113062024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
113072024-12-18T22:26:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113082024-12-18T22:26:13.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
113092024-12-18T22:26:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113102024-12-18T22:26:13.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
113112024-12-18T22:26:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.138923ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
113122024-12-18T22:26:13.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113132024-12-18T22:26:13.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113142024-12-18T22:26:13.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.724873ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113152024-12-18T22:26:13.802ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.719943ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
113162024-12-18T22:26:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113172024-12-18T22:26:13.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113182024-12-18T22:26:13.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 420566981 } })
113192024-12-18T22:26:13.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113202024-12-18T22:26:13.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
113212024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113222024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113232024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113242024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113252024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
113262024-12-18T22:26:13.804ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
113272024-12-18T22:26:13.804ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.670741ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
113282024-12-18T22:26:13.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113292024-12-18T22:26:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113302024-12-18T22:26:13.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113312024-12-18T22:26:13.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113322024-12-18T22:26:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113332024-12-18T22:26:13.807ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:16:13.797817179 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
113342024-12-18T22:26:13.807ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.722561ms iteration = 13 status = {"expiration":"2024-12-18T22:16:13.797817179Z","pruned":[]}
113352024-12-18T22:26:13.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113362024-12-18T22:26:13.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113372024-12-18T22:26:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113382024-12-18T22:26:13.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113392024-12-18T22:26:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113402024-12-18T22:26:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
113412024-12-18T22:26:13.809ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
113422024-12-18T22:26:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113432024-12-18T22:26:13.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113442024-12-18T22:26:13.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113452024-12-18T22:26:13.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113462024-12-18T22:26:13.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113472024-12-18T22:26:13.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 429569878 } })
113482024-12-18T22:26:13.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
113492024-12-18T22:26:13.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.455334ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
113502024-12-18T22:26:13.813ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113512024-12-18T22:26:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
113522024-12-18T22:26:13.815ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
113532024-12-18T22:26:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
113542024-12-18T22:26:13.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113552024-12-18T22:26:13.816ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113562024-12-18T22:26:13.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113572024-12-18T22:26:13.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 436185708 } })
113582024-12-18T22:26:13.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
113592024-12-18T22:26:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113602024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113612024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113622024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
113632024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
113642024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113652024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113662024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113672024-12-18T22:26:13.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
113682024-12-18T22:26:13.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113692024-12-18T22:26:13.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113702024-12-18T22:26:13.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113712024-12-18T22:26:13.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113722024-12-18T22:26:13.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113732024-12-18T22:26:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
113742024-12-18T22:26:13.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113752024-12-18T22:26:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113762024-12-18T22:26:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113772024-12-18T22:26:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113782024-12-18T22:26:13.855ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
113792024-12-18T22:26:13.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.668332ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
113802024-12-18T22:26:13.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113812024-12-18T22:26:13.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.15313ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
113822024-12-18T22:26:13.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113832024-12-18T22:26:13.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113842024-12-18T22:26:13.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113852024-12-18T22:26:13.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113862024-12-18T22:26:13.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113872024-12-18T22:26:13.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113882024-12-18T22:26:13.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.958785ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113892024-12-18T22:26:13.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113902024-12-18T22:26:13.862ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113912024-12-18T22:26:13.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.650759ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
113922024-12-18T22:26:13.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113932024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
113942024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113952024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113962024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113972024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113982024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113992024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114002024-12-18T22:26:13.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114012024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114022024-12-18T22:26:13.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114032024-12-18T22:26:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114042024-12-18T22:26:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114052024-12-18T22:26:13.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114062024-12-18T22:26:13.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114072024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114082024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114092024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
114102024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
114112024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
114122024-12-18T22:26:13.866ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114132024-12-18T22:26:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
114142024-12-18T22:26:13.869ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
114152024-12-18T22:26:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
114162024-12-18T22:26:13.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114172024-12-18T22:26:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
114182024-12-18T22:26:13.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
114192024-12-18T22:26:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
114202024-12-18T22:26:13.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114212024-12-18T22:26:13.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114222024-12-18T22:26:13.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114232024-12-18T22:26:13.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114242024-12-18T22:26:13.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114252024-12-18T22:26:13.878ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.497579ms iteration = 6 status = {"nsuccess":5}
114262024-12-18T22:26:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114272024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114282024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114292024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
114302024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
114312024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
114322024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114332024-12-18T22:26:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114342024-12-18T22:26:13.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114352024-12-18T22:26:13.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114362024-12-18T22:26:13.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114372024-12-18T22:26:13.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114382024-12-18T22:26:13.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114392024-12-18T22:26:13.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
114402024-12-18T22:26:13.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
114412024-12-18T22:26:13.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
114422024-12-18T22:26:13.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114432024-12-18T22:26:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114442024-12-18T22:26:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114452024-12-18T22:26:13.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114462024-12-18T22:26:13.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114472024-12-18T22:26:13.888ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
114482024-12-18T22:26:13.888ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
114492024-12-18T22:26:13.888ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.264081ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
114502024-12-18T22:26:13.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5774a59-91d3-497d-9ce0-b44a398e4892 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
114512024-12-18T22:26:13.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5774a59-91d3-497d-9ce0-b44a398e4892 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
114522024-12-18T22:26:13.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d5774a59-91d3-497d-9ce0-b44a398e4892 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
114532024-12-18T22:26:13.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114542024-12-18T22:26:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114552024-12-18T22:26:13.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114562024-12-18T22:26:13.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114572024-12-18T22:26:13.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114582024-12-18T22:26:13.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114592024-12-18T22:26:13.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.221696ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
114602024-12-18T22:26:13.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
114612024-12-18T22:26:13.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
114622024-12-18T22:26:13.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.815094ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114632024-12-18T22:26:13.915ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114642024-12-18T22:26:13.915ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
114652024-12-18T22:26:13.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114662024-12-18T22:26:13.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114672024-12-18T22:26:13.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114682024-12-18T22:26:13.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114692024-12-18T22:26:13.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114702024-12-18T22:26:13.925ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
114712024-12-18T22:26:13.925ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
114722024-12-18T22:26:13.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114732024-12-18T22:26:13.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114742024-12-18T22:26:13.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.628394ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
114752024-12-18T22:26:13.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114762024-12-18T22:26:13.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
114772024-12-18T22:26:13.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114782024-12-18T22:26:13.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114792024-12-18T22:26:13.928ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
114802024-12-18T22:26:13.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 132.156622ms iteration = 25 status = 0
114812024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
114822024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
114832024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114842024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114852024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114862024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114872024-12-18T22:26:13.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114882024-12-18T22:26:13.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114892024-12-18T22:26:13.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
114902024-12-18T22:26:13.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
114912024-12-18T22:26:13.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
114922024-12-18T22:26:13.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 134.674002ms iteration = 13 status = {"generation":2}
114932024-12-18T22:26:13.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114942024-12-18T22:26:13.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114952024-12-18T22:26:13.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114962024-12-18T22:26:13.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
114972024-12-18T22:26:13.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
114982024-12-18T22:26:13.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
114992024-12-18T22:26:13.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
115002024-12-18T22:26:13.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 139.418495ms iteration = 13 status = {"generation":1}
115012024-12-18T22:26:13.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115022024-12-18T22:26:13.951ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115032024-12-18T22:26:13.951ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115042024-12-18T22:26:13.951ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.094794ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115052024-12-18T22:26:13.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115062024-12-18T22:26:13.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115072024-12-18T22:26:13.953ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
115082024-12-18T22:26:13.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115092024-12-18T22:26:13.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115102024-12-18T22:26:13.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115112024-12-18T22:26:13.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115122024-12-18T22:26:13.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115132024-12-18T22:26:13.961ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115142024-12-18T22:26:13.961ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be871988-d241-421e-875d-751562e8281f", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
115152024-12-18T22:26:13.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115162024-12-18T22:26:13.961ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2c8928-b3fa-4a60-bd6a-92718580419f", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
115172024-12-18T22:26:13.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115182024-12-18T22:26:13.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115192024-12-18T22:26:13.964ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
115202024-12-18T22:26:13.964ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 166.625049ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
115212024-12-18T22:26:13.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115222024-12-18T22:26:13.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
115232024-12-18T22:26:13.969ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115242024-12-18T22:26:13.970ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4965a0-18df-4dc2-8bd2-a3cf9024841e", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
115252024-12-18T22:26:13.970ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115262024-12-18T22:26:13.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
115272024-12-18T22:26:13.999ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
115282024-12-18T22:26:13.999ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 201.199758ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
115292024-12-18T22:26:14.004ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.664445ms iteration = 28 status = {"physical_disks_added":0}
115302024-12-18T22:26:14.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115312024-12-18T22:26:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115322024-12-18T22:26:14.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115332024-12-18T22:26:14.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115342024-12-18T22:26:14.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115352024-12-18T22:26:14.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115362024-12-18T22:26:14.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115372024-12-18T22:26:14.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115382024-12-18T22:26:14.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115392024-12-18T22:26:14.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115402024-12-18T22:26:14.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
115412024-12-18T22:26:14.109ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7129667e-7222-4f50-a423-a5fc6807ef6a", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115422024-12-18T22:26:14.109ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115432024-12-18T22:26:14.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "004acc17-b9bb-4513-bfc3-0e6fbb4615c1", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115442024-12-18T22:26:14.110ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115452024-12-18T22:26:14.111ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115462024-12-18T22:26:14.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 313.846428ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
115472024-12-18T22:26:14.113ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
115482024-12-18T22:26:14.160ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.485012ms iteration = 25 status = {}
115492024-12-18T22:26:14.283ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115502024-12-18T22:26:14.284ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e190cf0-3239-49d0-a7e1-4ddc27db2bf0", "content-length": "2", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
115512024-12-18T22:26:14.286ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115522024-12-18T22:26:14.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115532024-12-18T22:26:14.291ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115542024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115552024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
115562024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc559395-cea8-431d-8226-525e56dbabb0", "content-length": "372", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
115572024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115582024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115592024-12-18T22:26:14.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "affdea03-cc6f-408c-9e76-8a28279f5b28", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115602024-12-18T22:26:14.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115612024-12-18T22:26:14.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "364500b2-9900-427d-96b5-3ce3a7c221eb", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115622024-12-18T22:26:14.293ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115632024-12-18T22:26:14.294ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7ba3a479-ffd1-4f9e-96b8-7995dfb2ced4", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115642024-12-18T22:26:14.294ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115652024-12-18T22:26:14.296ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
115662024-12-18T22:26:14.296ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 498.541372ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
115672024-12-18T22:26:14.320ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115682024-12-18T22:26:14.320ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "00888754-8f87-4bcd-bac6-9886a4e66f70", "content-length": "691", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
115692024-12-18T22:26:14.320ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115702024-12-18T22:26:14.320ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115712024-12-18T22:26:14.320ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115722024-12-18T22:26:14.322ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 524.553382ms iteration = 25 status = null
115732024-12-18T22:26:14.322ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.672864ms iteration = 26 status = {}
115742024-12-18T22:26:14.333ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115752024-12-18T22:26:14.333ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115762024-12-18T22:26:14.333ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f90ed822-e194-48df-999e-ea9b0535f7cc", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
115772024-12-18T22:26:14.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115782024-12-18T22:26:14.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115792024-12-18T22:26:14.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115802024-12-18T22:26:14.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115812024-12-18T22:26:14.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115822024-12-18T22:26:14.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115832024-12-18T22:26:14.341ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115842024-12-18T22:26:14.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115852024-12-18T22:26:14.341ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ee7676cd-50fe-45f1-8f9a-468845bcee11", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
115862024-12-18T22:26:14.343ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 545.136876ms iteration = 26 status = {}
115872024-12-18T22:26:14.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115882024-12-18T22:26:14.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115892024-12-18T22:26:14.369ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
115902024-12-18T22:26:14.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115912024-12-18T22:26:14.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115922024-12-18T22:26:14.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115932024-12-18T22:26:14.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3179edb2-ab0f-4eee-905e-8a8ed7e51189", "content-length": "134", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
115942024-12-18T22:26:14.378ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115952024-12-18T22:26:14.378ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
115962024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115972024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115982024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115992024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116002024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116012024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116022024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116032024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116042024-12-18T22:26:14.379ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
116052024-12-18T22:26:14.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116062024-12-18T22:26:14.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116072024-12-18T22:26:14.381ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116082024-12-18T22:26:14.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "71e48477-6157-4e35-a023-4ee4c3220788", "content-length": "2", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
116092024-12-18T22:26:14.381ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116102024-12-18T22:26:14.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e26eff3-93e0-4774-93cc-e59d760cfd7f", "content-length": "52", "date": "Wed, 18 Dec 2024 22:26:13 GMT"} })
116112024-12-18T22:26:14.381ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
116122024-12-18T22:26:14.381ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116132024-12-18T22:26:14.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23c4f092-4694-4613-967b-4a179d8b8add", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
116142024-12-18T22:26:14.474ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
116152024-12-18T22:26:14.474ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116162024-12-18T22:26:14.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d788bcc4-4549-4189-9cb5-d312dd16205b", "content-length": "682", "date": "Wed, 18 Dec 2024 22:26:14 GMT"} })
116172024-12-18T22:26:14.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116182024-12-18T22:26:14.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116192024-12-18T22:26:14.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116202024-12-18T22:26:14.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116212024-12-18T22:26:14.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116222024-12-18T22:26:14.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116232024-12-18T22:26:14.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116242024-12-18T22:26:14.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116252024-12-18T22:26:14.490ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 692.331953ms iteration = 25 status = {}
116262024-12-18T22:26:14.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 598ed5e5-7d5c-4ecf-8236-4349dbb17d88 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116272024-12-18T22:26:14.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 598ed5e5-7d5c-4ecf-8236-4349dbb17d88 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116282024-12-18T22:26:14.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 598ed5e5-7d5c-4ecf-8236-4349dbb17d88 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116292024-12-18T22:26:15.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa7b5ad9-5c61-4221-ad4e-b54b63652122 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116302024-12-18T22:26:15.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa7b5ad9-5c61-4221-ad4e-b54b63652122 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116312024-12-18T22:26:15.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = aa7b5ad9-5c61-4221-ad4e-b54b63652122 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116322024-12-18T22:26:16.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 30ec4997-2842-4941-89ec-7817fdea64aa response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
116332024-12-18T22:26:16.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8fdd4971-486c-47ce-9ca4-750500c38b1e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116342024-12-18T22:26:16.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8fdd4971-486c-47ce-9ca4-750500c38b1e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116352024-12-18T22:26:16.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8fdd4971-486c-47ce-9ca4-750500c38b1e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116362024-12-18T22:26:17.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 80feb563-1541-42f6-b9db-4da44bdc728b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
116372024-12-18T22:26:17.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 80feb563-1541-42f6-b9db-4da44bdc728b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
116382024-12-18T22:26:17.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 80feb563-1541-42f6-b9db-4da44bdc728b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
116392024-12-18T22:26:17.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 23041c17-2ea9-4570-a405-16c38c5e1f22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116402024-12-18T22:26:17.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 23041c17-2ea9-4570-a405-16c38c5e1f22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116412024-12-18T22:26:17.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 23041c17-2ea9-4570-a405-16c38c5e1f22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116422024-12-18T22:26:19.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 97ad1386-66e5-4370-a532-9681a29268b5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116432024-12-18T22:26:19.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 97ad1386-66e5-4370-a532-9681a29268b5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116442024-12-18T22:26:19.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 97ad1386-66e5-4370-a532-9681a29268b5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116452024-12-18T22:26:20.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd836f4d-a0e6-48de-a3a2-2452696d7cf7 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116462024-12-18T22:26:20.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd836f4d-a0e6-48de-a3a2-2452696d7cf7 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116472024-12-18T22:26:20.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = dd836f4d-a0e6-48de-a3a2-2452696d7cf7 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116482024-12-18T22:26:21.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9b380e6-201b-4af9-9072-d4437b0d459b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116492024-12-18T22:26:21.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9b380e6-201b-4af9-9072-d4437b0d459b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116502024-12-18T22:26:21.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a9b380e6-201b-4af9-9072-d4437b0d459b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116512024-12-18T22:26:22.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb62e994-9568-49fd-a82d-22ce194d9109 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116522024-12-18T22:26:22.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb62e994-9568-49fd-a82d-22ce194d9109 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116532024-12-18T22:26:22.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bb62e994-9568-49fd-a82d-22ce194d9109 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116542024-12-18T22:26:23.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 388cdf8b-194a-4839-842f-64e4a5e230d3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116552024-12-18T22:26:23.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 388cdf8b-194a-4839-842f-64e4a5e230d3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116562024-12-18T22:26:23.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 388cdf8b-194a-4839-842f-64e4a5e230d3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116572024-12-18T22:26:23.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
116582024-12-18T22:26:23.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116592024-12-18T22:26:23.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
116602024-12-18T22:26:23.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116612024-12-18T22:26:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116622024-12-18T22:26:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116632024-12-18T22:26:23.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116642024-12-18T22:26:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116652024-12-18T22:26:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116662024-12-18T22:26:23.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.024699ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116672024-12-18T22:26:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116682024-12-18T22:26:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116692024-12-18T22:26:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116702024-12-18T22:26:23.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116712024-12-18T22:26:23.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116722024-12-18T22:26:23.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116732024-12-18T22:26:23.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
116742024-12-18T22:26:23.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116752024-12-18T22:26:23.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116762024-12-18T22:26:23.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
116772024-12-18T22:26:23.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.390819ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
116782024-12-18T22:26:24.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2285255e-2375-4e50-a4d0-50617f18c3d8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116792024-12-18T22:26:24.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2285255e-2375-4e50-a4d0-50617f18c3d8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116802024-12-18T22:26:24.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 2285255e-2375-4e50-a4d0-50617f18c3d8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116812024-12-18T22:26:25.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d19d00c-00f6-478b-a442-e257633ad484 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116822024-12-18T22:26:25.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d19d00c-00f6-478b-a442-e257633ad484 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116832024-12-18T22:26:25.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d19d00c-00f6-478b-a442-e257633ad484 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116842024-12-18T22:26:26.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1aa7504-1ac6-432d-b26a-511a0199f13d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116852024-12-18T22:26:26.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1aa7504-1ac6-432d-b26a-511a0199f13d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116862024-12-18T22:26:26.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b1aa7504-1ac6-432d-b26a-511a0199f13d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116872024-12-18T22:26:26.628ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45569
116882024-12-18T22:26:26.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = fe2a1acc-955e-4534-aec9-4a5099adb381 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
116892024-12-18T22:26:26.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = fe2a1acc-955e-4534-aec9-4a5099adb381 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
116902024-12-18T22:26:26.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = fe2a1acc-955e-4534-aec9-4a5099adb381 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
116912024-12-18T22:26:26.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 82c388b9-6288-4b0b-b0eb-df38e4b403d6 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
116922024-12-18T22:26:26.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 82c388b9-6288-4b0b-b0eb-df38e4b403d6 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
116932024-12-18T22:26:26.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 82c388b9-6288-4b0b-b0eb-df38e4b403d6 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
116942024-12-18T22:26:26.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = e6ca7633-3623-488e-a534-735754f49078 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
116952024-12-18T22:26:27.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae4d0186-a175-40f7-a1d1-0ff8277c91a8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116962024-12-18T22:26:27.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae4d0186-a175-40f7-a1d1-0ff8277c91a8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116972024-12-18T22:26:27.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ae4d0186-a175-40f7-a1d1-0ff8277c91a8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116982024-12-18T22:26:28.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf4cf17e-8eff-4dc2-b05b-c3a0a1c31b0b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
116992024-12-18T22:26:28.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf4cf17e-8eff-4dc2-b05b-c3a0a1c31b0b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117002024-12-18T22:26:28.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = cf4cf17e-8eff-4dc2-b05b-c3a0a1c31b0b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117012024-12-18T22:26:29.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3c9b014-0167-4365-b466-9f1a63d606ae roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117022024-12-18T22:26:29.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3c9b014-0167-4365-b466-9f1a63d606ae resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117032024-12-18T22:26:29.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f3c9b014-0167-4365-b466-9f1a63d606ae response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117042024-12-18T22:26:30.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e23a8e92-7072-42de-aac6-1ea03f6ef813 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117052024-12-18T22:26:30.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e23a8e92-7072-42de-aac6-1ea03f6ef813 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117062024-12-18T22:26:30.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e23a8e92-7072-42de-aac6-1ea03f6ef813 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117072024-12-18T22:26:31.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a847e4b1-0770-4a62-b837-1968d32a230a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117082024-12-18T22:26:31.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a847e4b1-0770-4a62-b837-1968d32a230a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117092024-12-18T22:26:31.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a847e4b1-0770-4a62-b837-1968d32a230a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117102024-12-18T22:26:32.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3437a7a8-d74c-4a33-a69e-484d5b30dde3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117112024-12-18T22:26:32.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3437a7a8-d74c-4a33-a69e-484d5b30dde3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117122024-12-18T22:26:32.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3437a7a8-d74c-4a33-a69e-484d5b30dde3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117132024-12-18T22:26:33.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f707af25-dd1d-472b-8b09-eb6c2cdd590c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117142024-12-18T22:26:33.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f707af25-dd1d-472b-8b09-eb6c2cdd590c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117152024-12-18T22:26:33.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f707af25-dd1d-472b-8b09-eb6c2cdd590c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117162024-12-18T22:26:33.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
117172024-12-18T22:26:33.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
117182024-12-18T22:26:33.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117192024-12-18T22:26:33.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117202024-12-18T22:26:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117212024-12-18T22:26:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117222024-12-18T22:26:33.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117232024-12-18T22:26:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117242024-12-18T22:26:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117252024-12-18T22:26:33.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.179912ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117262024-12-18T22:26:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117272024-12-18T22:26:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117282024-12-18T22:26:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117292024-12-18T22:26:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117302024-12-18T22:26:33.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117312024-12-18T22:26:33.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117322024-12-18T22:26:33.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
117332024-12-18T22:26:33.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117342024-12-18T22:26:33.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117352024-12-18T22:26:33.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
117362024-12-18T22:26:33.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.012962ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
117372024-12-18T22:26:34.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44759c0a-d85b-47bb-9d20-3f945a6c4afb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117382024-12-18T22:26:34.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44759c0a-d85b-47bb-9d20-3f945a6c4afb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117392024-12-18T22:26:34.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 44759c0a-d85b-47bb-9d20-3f945a6c4afb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117402024-12-18T22:26:35.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b11a14-ddc3-4c18-8546-c0107af5b755 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117412024-12-18T22:26:35.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b11a14-ddc3-4c18-8546-c0107af5b755 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117422024-12-18T22:26:35.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7b11a14-ddc3-4c18-8546-c0107af5b755 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117432024-12-18T22:26:36.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39383b9f-9faa-494a-a860-335e8c3a6dfe roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117442024-12-18T22:26:36.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39383b9f-9faa-494a-a860-335e8c3a6dfe resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117452024-12-18T22:26:36.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39383b9f-9faa-494a-a860-335e8c3a6dfe response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117462024-12-18T22:26:36.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 645b8ed5-838f-421e-a60e-0b406e63b766 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
117472024-12-18T22:26:37.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = af6ad0e8-f160-4c04-807e-bd4cccc8d39c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117482024-12-18T22:26:37.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = af6ad0e8-f160-4c04-807e-bd4cccc8d39c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117492024-12-18T22:26:37.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = af6ad0e8-f160-4c04-807e-bd4cccc8d39c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117502024-12-18T22:26:38.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe76594b-1f9b-45cf-a0b4-27b233668055 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117512024-12-18T22:26:38.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe76594b-1f9b-45cf-a0b4-27b233668055 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117522024-12-18T22:26:38.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe76594b-1f9b-45cf-a0b4-27b233668055 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117532024-12-18T22:26:39.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e9620c9-a6a3-4317-aee5-6603fc42d478 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117542024-12-18T22:26:39.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e9620c9-a6a3-4317-aee5-6603fc42d478 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117552024-12-18T22:26:39.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7e9620c9-a6a3-4317-aee5-6603fc42d478 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117562024-12-18T22:26:40.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5df9232e-7af8-4b7f-a2ca-8a1f983c8e1d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117572024-12-18T22:26:40.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5df9232e-7af8-4b7f-a2ca-8a1f983c8e1d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117582024-12-18T22:26:40.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5df9232e-7af8-4b7f-a2ca-8a1f983c8e1d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117592024-12-18T22:26:41.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 468cd8e6-8f12-4c39-b3cd-8a618956dcfe roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117602024-12-18T22:26:41.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 468cd8e6-8f12-4c39-b3cd-8a618956dcfe resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117612024-12-18T22:26:41.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 468cd8e6-8f12-4c39-b3cd-8a618956dcfe response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117622024-12-18T22:26:42.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6d1a9831-1e26-47fe-b498-3d4a31e4d3b3 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117632024-12-18T22:26:42.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6d1a9831-1e26-47fe-b498-3d4a31e4d3b3 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117642024-12-18T22:26:42.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 6d1a9831-1e26-47fe-b498-3d4a31e4d3b3 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117652024-12-18T22:26:43.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d552b511-51cf-43cb-acff-e8122880ed98 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117662024-12-18T22:26:43.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d552b511-51cf-43cb-acff-e8122880ed98 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117672024-12-18T22:26:43.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d552b511-51cf-43cb-acff-e8122880ed98 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
117682024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
117692024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
117702024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117712024-12-18T22:26:43.797ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117722024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117732024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
117742024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
117752024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117762024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117772024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
117782024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
117792024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117802024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117812024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
117822024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117832024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117842024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
117852024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117862024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
117872024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117882024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
117892024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117902024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
117912024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117922024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
117932024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
117942024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117952024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
117962024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
117972024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117982024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
117992024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118002024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118012024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
118022024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118032024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118042024-12-18T22:26:43.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118052024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
118062024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118072024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118082024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118092024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118102024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118112024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118122024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118132024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118142024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118152024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118162024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
118172024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118182024-12-18T22:26:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118192024-12-18T22:26:43.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 418099353 } })
118202024-12-18T22:26:43.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
118212024-12-18T22:26:43.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118222024-12-18T22:26:43.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.898136ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
118232024-12-18T22:26:43.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118242024-12-18T22:26:43.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.221553ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118252024-12-18T22:26:43.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118262024-12-18T22:26:43.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118272024-12-18T22:26:43.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118282024-12-18T22:26:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118292024-12-18T22:26:43.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 421211814 } })
118302024-12-18T22:26:43.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
118312024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118322024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118332024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118342024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118352024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118362024-12-18T22:26:43.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118372024-12-18T22:26:43.806ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118382024-12-18T22:26:43.806ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118392024-12-18T22:26:43.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118402024-12-18T22:26:43.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118412024-12-18T22:26:43.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118422024-12-18T22:26:43.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118432024-12-18T22:26:43.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.439785ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
118442024-12-18T22:26:43.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118452024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118462024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118472024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118482024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118492024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118502024-12-18T22:26:43.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118512024-12-18T22:26:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118522024-12-18T22:26:43.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118532024-12-18T22:26:43.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118542024-12-18T22:26:43.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118552024-12-18T22:26:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118562024-12-18T22:26:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118572024-12-18T22:26:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118582024-12-18T22:26:43.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118592024-12-18T22:26:43.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118602024-12-18T22:26:43.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 432258170 } })
118612024-12-18T22:26:43.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
118622024-12-18T22:26:43.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118632024-12-18T22:26:43.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118642024-12-18T22:26:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118652024-12-18T22:26:43.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118662024-12-18T22:26:43.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118672024-12-18T22:26:43.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118682024-12-18T22:26:43.820ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118692024-12-18T22:26:43.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.744657ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118702024-12-18T22:26:43.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118712024-12-18T22:26:43.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118722024-12-18T22:26:43.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118732024-12-18T22:26:43.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118742024-12-18T22:26:43.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118752024-12-18T22:26:43.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118762024-12-18T22:26:43.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118772024-12-18T22:26:43.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118782024-12-18T22:26:43.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118792024-12-18T22:26:43.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118802024-12-18T22:26:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118812024-12-18T22:26:43.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118822024-12-18T22:26:43.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118832024-12-18T22:26:43.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118842024-12-18T22:26:43.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118852024-12-18T22:26:43.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 42.259769ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118862024-12-18T22:26:43.841ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118872024-12-18T22:26:43.841ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118882024-12-18T22:26:43.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118892024-12-18T22:26:43.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118902024-12-18T22:26:43.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118912024-12-18T22:26:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
118922024-12-18T22:26:43.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118932024-12-18T22:26:43.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118942024-12-18T22:26:43.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118952024-12-18T22:26:43.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118962024-12-18T22:26:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118972024-12-18T22:26:43.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.653675ms iteration = 26 status = 0
118982024-12-18T22:26:43.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118992024-12-18T22:26:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
119002024-12-18T22:26:43.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119012024-12-18T22:26:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119022024-12-18T22:26:43.852ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 55.00611ms iteration = 29 status = {"physical_disks_added":0}
119032024-12-18T22:26:43.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119042024-12-18T22:26:43.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119052024-12-18T22:26:43.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119062024-12-18T22:26:43.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119072024-12-18T22:26:43.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119082024-12-18T22:26:43.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
119092024-12-18T22:26:43.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.103899ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
119102024-12-18T22:26:43.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119112024-12-18T22:26:43.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119122024-12-18T22:26:43.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119132024-12-18T22:26:43.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.803511ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119142024-12-18T22:26:43.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.3333ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
119152024-12-18T22:26:43.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119162024-12-18T22:26:43.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119172024-12-18T22:26:43.870ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119182024-12-18T22:26:43.870ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
119192024-12-18T22:26:43.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.106884ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
119202024-12-18T22:26:43.893ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119212024-12-18T22:26:43.893ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119222024-12-18T22:26:43.893ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f02ee39-3170-4f9f-81d7-5f31f14a0ce0", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119232024-12-18T22:26:43.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119242024-12-18T22:26:43.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.678087ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
119252024-12-18T22:26:43.894ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119262024-12-18T22:26:43.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119272024-12-18T22:26:43.897ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119282024-12-18T22:26:43.897ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "60abf4d1-3401-42e8-8506-48773fb69c4d", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119292024-12-18T22:26:43.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119302024-12-18T22:26:43.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119312024-12-18T22:26:43.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
119322024-12-18T22:26:43.941ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119332024-12-18T22:26:43.941ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d989b1bb-4558-4f1e-a449-dda5af88badd", "content-length": "26", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119342024-12-18T22:26:43.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119352024-12-18T22:26:43.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
119362024-12-18T22:26:43.992ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119372024-12-18T22:26:43.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "611f9750-c3ea-4555-97dd-73e2dab22ea8", "content-length": "691", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119382024-12-18T22:26:43.993ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119392024-12-18T22:26:43.993ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119402024-12-18T22:26:43.993ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119412024-12-18T22:26:43.994ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 196.592598ms iteration = 27 status = {}
119422024-12-18T22:26:44.035ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 237.552051ms iteration = 26 status = {}
119432024-12-18T22:26:44.053ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119442024-12-18T22:26:44.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119452024-12-18T22:26:44.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1021e819-a5a9-47a9-a2d3-b2cab00d30cf", "content-length": "372", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119462024-12-18T22:26:44.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119472024-12-18T22:26:44.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119482024-12-18T22:26:44.069ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
119492024-12-18T22:26:44.069ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119502024-12-18T22:26:44.071ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d4fc96db-a76d-48ee-a08f-3631754152e3", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119512024-12-18T22:26:44.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119522024-12-18T22:26:44.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119532024-12-18T22:26:44.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119542024-12-18T22:26:44.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119552024-12-18T22:26:44.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119562024-12-18T22:26:44.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119572024-12-18T22:26:44.080ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119582024-12-18T22:26:44.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119592024-12-18T22:26:44.081ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e62beff4-548f-4404-9889-f335798633f1", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119602024-12-18T22:26:44.083ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.709926ms iteration = 27 status = {}
119612024-12-18T22:26:44.085ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119622024-12-18T22:26:44.086ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cdba2f2-1d42-4bc9-96c2-656df5b498d8", "content-length": "2", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119632024-12-18T22:26:44.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119642024-12-18T22:26:44.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119652024-12-18T22:26:44.090ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.762764ms iteration = 26 status = null
119662024-12-18T22:26:44.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119672024-12-18T22:26:44.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119682024-12-18T22:26:44.161ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
119692024-12-18T22:26:44.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119702024-12-18T22:26:44.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119712024-12-18T22:26:44.170ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119722024-12-18T22:26:44.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dff0a2f5-4372-4a8f-9562-b74eef20f2d7", "content-length": "134", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119732024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119742024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
119752024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119762024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119772024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119782024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119792024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119802024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119812024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119822024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119832024-12-18T22:26:44.171ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
119842024-12-18T22:26:44.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119852024-12-18T22:26:44.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119862024-12-18T22:26:44.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119872024-12-18T22:26:44.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a38744f-5dec-4d45-853a-84df0e67e604", "content-length": "2", "date": "Wed, 18 Dec 2024 22:26:43 GMT"} })
119882024-12-18T22:26:44.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119892024-12-18T22:26:44.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f23f5ee-260d-4e51-948c-23d0f090807c", "content-length": "52", "date": "Wed, 18 Dec 2024 22:26:44 GMT"} })
119902024-12-18T22:26:44.174ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
119912024-12-18T22:26:44.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119922024-12-18T22:26:44.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7b6d502-9345-473d-a867-b03d1f3de7b0", "date": "Wed, 18 Dec 2024 22:26:44 GMT"} })
119932024-12-18T22:26:44.264ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
119942024-12-18T22:26:44.264ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119952024-12-18T22:26:44.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "61af153f-3072-44d4-9fe4-8d08cb6f382b", "content-length": "682", "date": "Wed, 18 Dec 2024 22:26:44 GMT"} })
119962024-12-18T22:26:44.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119972024-12-18T22:26:44.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119982024-12-18T22:26:44.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119992024-12-18T22:26:44.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120002024-12-18T22:26:44.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120012024-12-18T22:26:44.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120022024-12-18T22:26:44.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120032024-12-18T22:26:44.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120042024-12-18T22:26:44.282ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.655619ms iteration = 26 status = {}
120052024-12-18T22:26:44.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 421144af-3548-46fd-928f-b428c7b53c01 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120062024-12-18T22:26:44.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 421144af-3548-46fd-928f-b428c7b53c01 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120072024-12-18T22:26:44.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 421144af-3548-46fd-928f-b428c7b53c01 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120082024-12-18T22:26:45.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3746e50f-6dcd-48c4-aeb4-fbba1337b872 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120092024-12-18T22:26:45.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3746e50f-6dcd-48c4-aeb4-fbba1337b872 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120102024-12-18T22:26:45.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3746e50f-6dcd-48c4-aeb4-fbba1337b872 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120112024-12-18T22:26:46.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d69d48-812f-40af-888f-b8bc6401facc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120122024-12-18T22:26:46.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d69d48-812f-40af-888f-b8bc6401facc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120132024-12-18T22:26:46.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 71d69d48-812f-40af-888f-b8bc6401facc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120142024-12-18T22:26:46.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 708 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 80eadc21-ae28-4489-b740-d57b06a7efb7 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
120152024-12-18T22:26:47.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe645965-a072-4011-9fce-f0967d82097c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120162024-12-18T22:26:47.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe645965-a072-4011-9fce-f0967d82097c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120172024-12-18T22:26:47.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fe645965-a072-4011-9fce-f0967d82097c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120182024-12-18T22:26:47.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e7c9c9fb-7582-4898-a138-f5474f62d408 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
120192024-12-18T22:26:47.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e7c9c9fb-7582-4898-a138-f5474f62d408 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
120202024-12-18T22:26:47.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = e7c9c9fb-7582-4898-a138-f5474f62d408 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
120212024-12-18T22:26:48.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1106bbb6-0d5f-477b-b97d-af277111ff9d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120222024-12-18T22:26:48.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1106bbb6-0d5f-477b-b97d-af277111ff9d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120232024-12-18T22:26:48.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 1106bbb6-0d5f-477b-b97d-af277111ff9d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120242024-12-18T22:26:49.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14789f43-5b77-4c6d-b74c-0a507015d671 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120252024-12-18T22:26:49.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14789f43-5b77-4c6d-b74c-0a507015d671 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120262024-12-18T22:26:49.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 14789f43-5b77-4c6d-b74c-0a507015d671 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120272024-12-18T22:26:50.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0eebb1-f83b-4c73-b194-92d15bbe6468 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120282024-12-18T22:26:50.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0eebb1-f83b-4c73-b194-92d15bbe6468 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120292024-12-18T22:26:50.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5f0eebb1-f83b-4c73-b194-92d15bbe6468 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120302024-12-18T22:26:51.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcd92caa-22bf-45ad-8ee3-274778024b6e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120312024-12-18T22:26:51.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcd92caa-22bf-45ad-8ee3-274778024b6e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120322024-12-18T22:26:51.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fcd92caa-22bf-45ad-8ee3-274778024b6e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120332024-12-18T22:26:52.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e1a9445-e8bd-487d-a49f-2a761f231a3c roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120342024-12-18T22:26:52.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e1a9445-e8bd-487d-a49f-2a761f231a3c resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120352024-12-18T22:26:52.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8e1a9445-e8bd-487d-a49f-2a761f231a3c response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120362024-12-18T22:26:53.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f161f30-bef2-444e-9125-4020d2c83a22 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120372024-12-18T22:26:53.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f161f30-bef2-444e-9125-4020d2c83a22 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120382024-12-18T22:26:53.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8f161f30-bef2-444e-9125-4020d2c83a22 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120392024-12-18T22:26:53.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
120402024-12-18T22:26:53.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
120412024-12-18T22:26:53.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120422024-12-18T22:26:53.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120432024-12-18T22:26:53.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120442024-12-18T22:26:53.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120452024-12-18T22:26:53.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120462024-12-18T22:26:53.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120472024-12-18T22:26:53.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120482024-12-18T22:26:53.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.656521ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120492024-12-18T22:26:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120502024-12-18T22:26:53.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120512024-12-18T22:26:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120522024-12-18T22:26:53.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120532024-12-18T22:26:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120542024-12-18T22:26:53.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120552024-12-18T22:26:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
120562024-12-18T22:26:53.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120572024-12-18T22:26:53.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120582024-12-18T22:26:53.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
120592024-12-18T22:26:53.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.783559ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
120602024-12-18T22:26:54.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5dc4f283-9944-4431-ac23-bc649bee5531 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120612024-12-18T22:26:54.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5dc4f283-9944-4431-ac23-bc649bee5531 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120622024-12-18T22:26:54.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5dc4f283-9944-4431-ac23-bc649bee5531 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120632024-12-18T22:26:55.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33263d3f-c215-4421-b743-54ac442bc537 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120642024-12-18T22:26:55.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33263d3f-c215-4421-b743-54ac442bc537 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120652024-12-18T22:26:55.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 33263d3f-c215-4421-b743-54ac442bc537 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120662024-12-18T22:26:56.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = bd962dfc-2aad-497c-b41f-8a2543933259 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
120672024-12-18T22:26:56.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5531b603-2ead-4a35-ae72-463c4baa3e00 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120682024-12-18T22:26:56.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5531b603-2ead-4a35-ae72-463c4baa3e00 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120692024-12-18T22:26:56.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5531b603-2ead-4a35-ae72-463c4baa3e00 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120702024-12-18T22:26:57.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a2f0aec-9424-4448-a6bb-0dce5e97b25a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120712024-12-18T22:26:57.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a2f0aec-9424-4448-a6bb-0dce5e97b25a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120722024-12-18T22:26:57.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8a2f0aec-9424-4448-a6bb-0dce5e97b25a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120732024-12-18T22:26:58.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c66d369f-c41e-4072-9e5b-7b35f525ff24 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120742024-12-18T22:26:58.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c66d369f-c41e-4072-9e5b-7b35f525ff24 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120752024-12-18T22:26:58.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c66d369f-c41e-4072-9e5b-7b35f525ff24 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120762024-12-18T22:26:59.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7298e95-2db0-4953-b9c7-5acf1894b20e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120772024-12-18T22:26:59.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7298e95-2db0-4953-b9c7-5acf1894b20e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120782024-12-18T22:26:59.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a7298e95-2db0-4953-b9c7-5acf1894b20e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120792024-12-18T22:27:00.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31a50272-ce98-4ddf-9620-5a5100e7bed9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120802024-12-18T22:27:00.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31a50272-ce98-4ddf-9620-5a5100e7bed9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120812024-12-18T22:27:00.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 31a50272-ce98-4ddf-9620-5a5100e7bed9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120822024-12-18T22:27:01.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d53192-8cfb-44ba-87f7-2404b7ec3566 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120832024-12-18T22:27:01.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d53192-8cfb-44ba-87f7-2404b7ec3566 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120842024-12-18T22:27:01.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b4d53192-8cfb-44ba-87f7-2404b7ec3566 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120852024-12-18T22:27:02.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bda49a3a-50c8-4612-adf8-ab154f7ccbf1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120862024-12-18T22:27:02.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bda49a3a-50c8-4612-adf8-ab154f7ccbf1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120872024-12-18T22:27:02.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bda49a3a-50c8-4612-adf8-ab154f7ccbf1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
120882024-12-18T22:27:03.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
120892024-12-18T22:27:03.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120902024-12-18T22:27:03.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
120912024-12-18T22:27:03.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120922024-12-18T22:27:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120932024-12-18T22:27:03.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120942024-12-18T22:27:03.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120952024-12-18T22:27:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120962024-12-18T22:27:03.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120972024-12-18T22:27:03.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.216463ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120982024-12-18T22:27:03.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120992024-12-18T22:27:03.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121002024-12-18T22:27:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121012024-12-18T22:27:03.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121022024-12-18T22:27:03.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121032024-12-18T22:27:03.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121042024-12-18T22:27:03.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
121052024-12-18T22:27:03.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121062024-12-18T22:27:03.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121072024-12-18T22:27:03.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
121082024-12-18T22:27:03.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.89014ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
121092024-12-18T22:27:03.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7e35bb4-6490-4454-b9c8-6dbe4310b30d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121102024-12-18T22:27:03.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7e35bb4-6490-4454-b9c8-6dbe4310b30d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121112024-12-18T22:27:03.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e7e35bb4-6490-4454-b9c8-6dbe4310b30d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121122024-12-18T22:27:04.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f992a6b1-088f-4428-80a4-252eeb7dea3d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121132024-12-18T22:27:04.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f992a6b1-088f-4428-80a4-252eeb7dea3d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121142024-12-18T22:27:04.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = f992a6b1-088f-4428-80a4-252eeb7dea3d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121152024-12-18T22:27:06.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706fdbbf-a76c-46fe-91f7-d413d507096e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121162024-12-18T22:27:06.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706fdbbf-a76c-46fe-91f7-d413d507096e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121172024-12-18T22:27:06.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 706fdbbf-a76c-46fe-91f7-d413d507096e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121182024-12-18T22:27:06.635ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 55b365c8-e436-4768-acdb-6913a9fa0e68 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
121192024-12-18T22:27:07.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0ac76e5-cb38-405c-8316-387ce2740b2b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121202024-12-18T22:27:07.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0ac76e5-cb38-405c-8316-387ce2740b2b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121212024-12-18T22:27:07.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c0ac76e5-cb38-405c-8316-387ce2740b2b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121222024-12-18T22:27:08.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e59c00e4-fd60-47cc-a85a-cf02d78be2b5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121232024-12-18T22:27:08.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e59c00e4-fd60-47cc-a85a-cf02d78be2b5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121242024-12-18T22:27:08.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e59c00e4-fd60-47cc-a85a-cf02d78be2b5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121252024-12-18T22:27:09.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c53cf15-f2c9-41a4-9a14-48ff3a886579 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121262024-12-18T22:27:09.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c53cf15-f2c9-41a4-9a14-48ff3a886579 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121272024-12-18T22:27:09.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3c53cf15-f2c9-41a4-9a14-48ff3a886579 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121282024-12-18T22:27:10.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7605d8cb-7e8e-4b6c-9158-87f13a0addd8 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121292024-12-18T22:27:10.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7605d8cb-7e8e-4b6c-9158-87f13a0addd8 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121302024-12-18T22:27:10.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 7605d8cb-7e8e-4b6c-9158-87f13a0addd8 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121312024-12-18T22:27:11.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05fcbaee-3958-48ce-a3cd-db5c0bebd902 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121322024-12-18T22:27:11.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05fcbaee-3958-48ce-a3cd-db5c0bebd902 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121332024-12-18T22:27:11.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 05fcbaee-3958-48ce-a3cd-db5c0bebd902 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121342024-12-18T22:27:11.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 1187a831-6af5-44ae-9bc2-639a3acbb0f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
121352024-12-18T22:27:11.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 1187a831-6af5-44ae-9bc2-639a3acbb0f0 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
121362024-12-18T22:27:11.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = 1187a831-6af5-44ae-9bc2-639a3acbb0f0 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
121372024-12-18T22:27:11.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = df68b4dc-9f73-4bb9-a0d7-f9143f8caf06 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
121382024-12-18T22:27:11.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = df68b4dc-9f73-4bb9-a0d7-f9143f8caf06 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
121392024-12-18T22:27:11.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = df68b4dc-9f73-4bb9-a0d7-f9143f8caf06 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
121402024-12-18T22:27:12.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df82da83-1af9-4d25-ab06-428869142b98 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121412024-12-18T22:27:12.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df82da83-1af9-4d25-ab06-428869142b98 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121422024-12-18T22:27:12.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = df82da83-1af9-4d25-ab06-428869142b98 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121432024-12-18T22:27:13.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc021c1c-1a2f-4188-b3a4-466c4e44bd56 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121442024-12-18T22:27:13.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc021c1c-1a2f-4188-b3a4-466c4e44bd56 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121452024-12-18T22:27:13.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = fc021c1c-1a2f-4188-b3a4-466c4e44bd56 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
121462024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
121472024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
121482024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121492024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121502024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
121512024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
121522024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
121532024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
121542024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121552024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121562024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
121572024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
121582024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121592024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121602024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
121612024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
121622024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
121632024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121642024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
121652024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
121662024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
121672024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121682024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
121692024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121702024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
121712024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121722024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
121732024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
121742024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121752024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121762024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
121772024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
121782024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121792024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121802024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
121812024-12-18T22:27:13.798ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
121822024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121832024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
121842024-12-18T22:27:13.798ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 22:17:13.798431890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
121852024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
121862024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
121872024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
121882024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
121892024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
121902024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121912024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
121922024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121932024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
121942024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121952024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
121962024-12-18T22:27:13.798ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121972024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121982024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
121992024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122002024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
122012024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122022024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122032024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122042024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
122052024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
122062024-12-18T22:27:13.798ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705
122072024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122082024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.13\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705"}
122092024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
122102024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
122112024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122122024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122132024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122142024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122152024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122162024-12-18T22:27:13.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122172024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122182024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122192024-12-18T22:27:13.799ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("160de9b3-61fd-47fd-9883-78dcc7b014f0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d0ef80fe-5a3c-4585-be47-819c465c7a37.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 416094553 } })
122202024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
122212024-12-18T22:27:13.799ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("30c41a31-69b8-4e44-8478-4a6de914f099.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("682b12ed-34b9-4e65-b536-774bb5cb2035.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bc74bb1a-84d7-44c0-adcf-bd86a0a3155f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 416100933 } })
122222024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122232024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122242024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
122252024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122262024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
122272024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122282024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122292024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122302024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122312024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122322024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122332024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122342024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
122352024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.336787ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
122362024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
122372024-12-18T22:27:13.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.332166ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
122382024-12-18T22:27:13.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122392024-12-18T22:27:13.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 421278765 } })
122402024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122412024-12-18T22:27:13.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
122422024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.893546ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122432024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122442024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122452024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122462024-12-18T22:27:13.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122472024-12-18T22:27:13.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 423818795 } })
122482024-12-18T22:27:13.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122492024-12-18T22:27:13.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122502024-12-18T22:27:13.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
122512024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122522024-12-18T22:27:13.807ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122532024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122542024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122552024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
122562024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
122572024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122582024-12-18T22:27:13.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122592024-12-18T22:27:13.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122602024-12-18T22:27:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122612024-12-18T22:27:13.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122622024-12-18T22:27:13.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122632024-12-18T22:27:13.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122642024-12-18T22:27:13.809ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 22:17:13.798431890 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
122652024-12-18T22:27:13.809ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.650639ms iteration = 14 status = {"expiration":"2024-12-18T22:17:13.798431890Z","pruned":[]}
122662024-12-18T22:27:13.810ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.907583ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
122672024-12-18T22:27:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122682024-12-18T22:27:13.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122692024-12-18T22:27:13.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122702024-12-18T22:27:13.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122712024-12-18T22:27:13.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122722024-12-18T22:27:13.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122732024-12-18T22:27:13.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122742024-12-18T22:27:13.814ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
122752024-12-18T22:27:13.814ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
122762024-12-18T22:27:13.814ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.34607ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
122772024-12-18T22:27:13.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122782024-12-18T22:27:13.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122792024-12-18T22:27:13.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122802024-12-18T22:27:13.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122812024-12-18T22:27:13.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122822024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122832024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122842024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122852024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122862024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122872024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122882024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122892024-12-18T22:27:13.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122902024-12-18T22:27:13.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122912024-12-18T22:27:13.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 438461432 } })
122922024-12-18T22:27:13.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
122932024-12-18T22:27:13.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122942024-12-18T22:27:13.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122952024-12-18T22:27:13.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122962024-12-18T22:27:13.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122972024-12-18T22:27:13.825ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
122982024-12-18T22:27:13.825ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.310626ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
122992024-12-18T22:27:13.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123002024-12-18T22:27:13.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123012024-12-18T22:27:13.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123022024-12-18T22:27:13.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123032024-12-18T22:27:13.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123042024-12-18T22:27:13.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123052024-12-18T22:27:13.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123062024-12-18T22:27:13.833ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123072024-12-18T22:27:13.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.589718ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
123082024-12-18T22:27:13.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123092024-12-18T22:27:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
123102024-12-18T22:27:13.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123112024-12-18T22:27:13.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123122024-12-18T22:27:13.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123132024-12-18T22:27:13.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123142024-12-18T22:27:13.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123152024-12-18T22:27:13.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123162024-12-18T22:27:13.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123172024-12-18T22:27:13.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123182024-12-18T22:27:13.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123192024-12-18T22:27:13.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123202024-12-18T22:27:13.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.726404ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
123212024-12-18T22:27:13.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123222024-12-18T22:27:13.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123232024-12-18T22:27:13.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.502117ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
123242024-12-18T22:27:13.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123252024-12-18T22:27:13.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123262024-12-18T22:27:13.865ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
123272024-12-18T22:27:13.866ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
123282024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.609657ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
123292024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
123302024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.459303ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
123312024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
123322024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
123332024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
123342024-12-18T22:27:13.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123352024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
123362024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
123372024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
123382024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123392024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123402024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123412024-12-18T22:27:13.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123422024-12-18T22:27:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123432024-12-18T22:27:13.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123442024-12-18T22:27:13.869ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123452024-12-18T22:27:13.869ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123462024-12-18T22:27:13.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123472024-12-18T22:27:13.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123482024-12-18T22:27:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123492024-12-18T22:27:13.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.300239ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123502024-12-18T22:27:13.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123512024-12-18T22:27:13.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123522024-12-18T22:27:13.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123532024-12-18T22:27:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123542024-12-18T22:27:13.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123552024-12-18T22:27:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123562024-12-18T22:27:13.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123572024-12-18T22:27:13.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123582024-12-18T22:27:13.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123592024-12-18T22:27:13.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123602024-12-18T22:27:13.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.805407ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123612024-12-18T22:27:13.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123622024-12-18T22:27:13.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123632024-12-18T22:27:13.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123642024-12-18T22:27:13.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 78.853877ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
123652024-12-18T22:27:13.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123662024-12-18T22:27:13.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123672024-12-18T22:27:13.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123682024-12-18T22:27:13.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123692024-12-18T22:27:13.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
123702024-12-18T22:27:13.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123712024-12-18T22:27:13.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123722024-12-18T22:27:13.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123732024-12-18T22:27:13.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123742024-12-18T22:27:13.881ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.098861ms iteration = 27 status = 0
123752024-12-18T22:27:13.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123762024-12-18T22:27:13.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
123772024-12-18T22:27:13.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123782024-12-18T22:27:13.886ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.483376ms iteration = 30 status = {"physical_disks_added":0}
123792024-12-18T22:27:13.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123802024-12-18T22:27:13.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.398903ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123812024-12-18T22:27:13.906ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
123822024-12-18T22:27:13.906ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
123832024-12-18T22:27:13.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123842024-12-18T22:27:13.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123852024-12-18T22:27:13.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123862024-12-18T22:27:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123872024-12-18T22:27:13.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123882024-12-18T22:27:13.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123892024-12-18T22:27:13.912ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
123902024-12-18T22:27:13.912ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 0 version = 2
123912024-12-18T22:27:13.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123922024-12-18T22:27:13.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123932024-12-18T22:27:13.913ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ce0326f3-b361-4ce8-ae9d-7f77ad808763 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
123942024-12-18T22:27:13.913ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
123952024-12-18T22:27:13.913ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 22:14:45.392434 UTC dns_group = internal generation = 1
123962024-12-18T22:27:13.913ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 115.645059ms iteration = 14 status = {"generation":1}
123972024-12-18T22:27:13.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123982024-12-18T22:27:13.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123992024-12-18T22:27:13.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
124002024-12-18T22:27:13.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124012024-12-18T22:27:13.918ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7c177b47-b9dc-4540-93e1-fcc7409c33de dns_zone_name = oxide.test found_so_far = 1 version = 2
124022024-12-18T22:27:13.918ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
124032024-12-18T22:27:13.918ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 22:14:46.290274 UTC dns_group = external generation = 2
124042024-12-18T22:27:13.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 120.350811ms iteration = 14 status = {"generation":2}
124052024-12-18T22:27:13.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124062024-12-18T22:27:13.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124072024-12-18T22:27:13.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124082024-12-18T22:27:13.922ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
124092024-12-18T22:27:13.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 123.935791ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
124102024-12-18T22:27:13.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
124112024-12-18T22:27:13.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124122024-12-18T22:27:13.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124132024-12-18T22:27:13.926ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
124142024-12-18T22:27:13.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
124152024-12-18T22:27:13.929ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T22:14:11.327376Z, time_modified: 2024-12-18T22:14:11.327376Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, db_silo: Silo { identity: SiloIdentity { id: 76b3a5a9-e9ba-496d-bfb7-72898689a859, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T22:14:46.239014Z, time_modified: 2024-12-18T22:14:46.239014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840" }] }) }
124162024-12-18T22:27:13.929ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 130.95649ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]}},"default_endpoint":{"silo_id":"76b3a5a9-e9ba-496d-bfb7-72898689a859","tls_certs":["076a28981607d0272a2a848d0f96d9d8aca0fc94b688e80e2dbddd5dfd55e840"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
124172024-12-18T22:27:13.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
124182024-12-18T22:27:13.948ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124192024-12-18T22:27:13.949ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd503157-f26d-4e56-a2da-496e3e99c8bb", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124202024-12-18T22:27:13.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124212024-12-18T22:27:13.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124222024-12-18T22:27:13.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124232024-12-18T22:27:13.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124242024-12-18T22:27:13.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124252024-12-18T22:27:13.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124262024-12-18T22:27:13.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124272024-12-18T22:27:13.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124282024-12-18T22:27:13.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124292024-12-18T22:27:13.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124302024-12-18T22:27:13.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124312024-12-18T22:27:13.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124322024-12-18T22:27:14.081ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
124332024-12-18T22:27:14.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
124342024-12-18T22:27:14.096ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124352024-12-18T22:27:14.096ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dedcd529-7f24-475c-8816-74f3b71f87ba", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124362024-12-18T22:27:14.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124372024-12-18T22:27:14.097ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124382024-12-18T22:27:14.105ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
124392024-12-18T22:27:14.106ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bbe7196-fd3d-48e6-829c-be38be9fd94f", "content-length": "2", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124402024-12-18T22:27:14.107ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124412024-12-18T22:27:14.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124422024-12-18T22:27:14.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
124432024-12-18T22:27:14.112ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124442024-12-18T22:27:14.113ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "624626d6-c6bf-458a-b6f3-64cf6e4e346f", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124452024-12-18T22:27:14.113ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124462024-12-18T22:27:14.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
124472024-12-18T22:27:14.119ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
124482024-12-18T22:27:14.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "28a1f02b-22c0-40ac-895c-b486f15ffc6f", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124492024-12-18T22:27:14.119ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124502024-12-18T22:27:14.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e4261222-5df4-44ac-83f2-2b33b3768e4a", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124512024-12-18T22:27:14.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124522024-12-18T22:27:14.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124532024-12-18T22:27:14.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.998267ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
124542024-12-18T22:27:14.131ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124552024-12-18T22:27:14.131ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124562024-12-18T22:27:14.131ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2207e54-f241-4a82-9e17-ddd3384e2404", "content-length": "372", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124572024-12-18T22:27:14.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124582024-12-18T22:27:14.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124592024-12-18T22:27:14.133ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 335.399591ms iteration = 27 status = null
124602024-12-18T22:27:14.172ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
124612024-12-18T22:27:14.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124622024-12-18T22:27:14.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fc5bc644-3c73-49be-8f47-7373e480ec16", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} })
124632024-12-18T22:27:14.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124642024-12-18T22:27:14.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124652024-12-18T22:27:14.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124662024-12-18T22:27:14.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124672024-12-18T22:27:14.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124682024-12-18T22:27:14.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124692024-12-18T22:27:14.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 960b1ccb-8a4b-442d-92fa-bfaa39049e34 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
124702024-12-18T22:27:14.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 960b1ccb-8a4b-442d-92fa-bfaa39049e34 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
124712024-12-18T22:27:14.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
124722024-12-18T22:27:14.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a681214d-ce2e-4cd7-9623-ac759d9d19d8", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124732024-12-18T22:27:14.209ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124742024-12-18T22:27:14.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "92f621c0-041d-42f6-9797-12b8e46051e6", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124752024-12-18T22:27:14.211ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124762024-12-18T22:27:14.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "84dbb965-da7b-49f2-9267-abfd568a6f4b", "date": "Wed, 18 Dec 2024 22:27:13 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124772024-12-18T22:27:14.212ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124782024-12-18T22:27:14.214ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
124792024-12-18T22:27:14.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 416.444731ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
124802024-12-18T22:27:14.224ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.062579ms iteration = 27 status = {}
124812024-12-18T22:27:14.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124822024-12-18T22:27:14.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c1a1c5e-e03a-484c-8f41-ac33096d8b01", "content-length": "691", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
124832024-12-18T22:27:14.237ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
124842024-12-18T22:27:14.237ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
124852024-12-18T22:27:14.237ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
124862024-12-18T22:27:14.239ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.665686ms iteration = 28 status = {}
124872024-12-18T22:27:14.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 960b1ccb-8a4b-442d-92fa-bfaa39049e34 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
124882024-12-18T22:27:14.240ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124892024-12-18T22:27:14.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124902024-12-18T22:27:14.246ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c632c77-0d9d-467b-8feb-a409b98a448e", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
124912024-12-18T22:27:14.248ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 450.089302ms iteration = 28 status = {}
124922024-12-18T22:27:14.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124932024-12-18T22:27:14.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124942024-12-18T22:27:14.295ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
124952024-12-18T22:27:14.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124962024-12-18T22:27:14.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124972024-12-18T22:27:14.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124982024-12-18T22:27:14.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7dd2207-1c32-467e-8ba9-f4045c55625c", "content-length": "134", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
124992024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
125002024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
125012024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
125022024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
125032024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125042024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125052024-12-18T22:27:14.304ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125062024-12-18T22:27:14.305ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
125072024-12-18T22:27:14.305ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125082024-12-18T22:27:14.305ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
125092024-12-18T22:27:14.305ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
125102024-12-18T22:27:14.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125112024-12-18T22:27:14.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125122024-12-18T22:27:14.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
125132024-12-18T22:27:14.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5ea6c1f-8afa-4198-8496-8f3dde171680", "content-length": "2", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
125142024-12-18T22:27:14.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
125152024-12-18T22:27:14.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b3bf8e-ca14-4ca5-a183-a2d0d21d449b", "content-length": "52", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
125162024-12-18T22:27:14.308ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
125172024-12-18T22:27:14.308ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
125182024-12-18T22:27:14.404ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d2d75d2d-b15a-4dca-ae3c-f6e3c791bb0a", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
125192024-12-18T22:27:14.404ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
125202024-12-18T22:27:14.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
125212024-12-18T22:27:14.404ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dea42652-a90f-43f9-903e-11c337e89e99", "content-length": "682", "date": "Wed, 18 Dec 2024 22:27:14 GMT"} })
125222024-12-18T22:27:14.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125232024-12-18T22:27:14.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125242024-12-18T22:27:14.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125252024-12-18T22:27:14.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125262024-12-18T22:27:14.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125272024-12-18T22:27:14.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125282024-12-18T22:27:14.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125292024-12-18T22:27:14.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125302024-12-18T22:27:14.423ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 625.341979ms iteration = 27 status = {}
125312024-12-18T22:27:15.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 948a7545-be0e-4ab6-864c-d3a08e0dc4a2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125322024-12-18T22:27:15.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 948a7545-be0e-4ab6-864c-d3a08e0dc4a2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125332024-12-18T22:27:15.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 948a7545-be0e-4ab6-864c-d3a08e0dc4a2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125342024-12-18T22:27:16.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45ce7974-39e3-4f09-b65f-fe76be657deb roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125352024-12-18T22:27:16.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45ce7974-39e3-4f09-b65f-fe76be657deb resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125362024-12-18T22:27:16.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 45ce7974-39e3-4f09-b65f-fe76be657deb response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125372024-12-18T22:27:16.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = a46a18b8-9be0-4cb1-89f7-13d7173e90c2 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
125382024-12-18T22:27:17.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12efa9f9-7d3a-4ba4-a087-c1f1e5580330 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125392024-12-18T22:27:17.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12efa9f9-7d3a-4ba4-a087-c1f1e5580330 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125402024-12-18T22:27:17.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 12efa9f9-7d3a-4ba4-a087-c1f1e5580330 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125412024-12-18T22:27:17.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 885f2070-351d-4385-b457-ce0b4fe2819c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
125422024-12-18T22:27:17.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 885f2070-351d-4385-b457-ce0b4fe2819c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
125432024-12-18T22:27:17.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 885f2070-351d-4385-b457-ce0b4fe2819c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
125442024-12-18T22:27:18.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76e5cef6-a288-47fc-a32a-00d3579ff425 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125452024-12-18T22:27:18.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76e5cef6-a288-47fc-a32a-00d3579ff425 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125462024-12-18T22:27:18.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76e5cef6-a288-47fc-a32a-00d3579ff425 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125472024-12-18T22:27:19.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 590cb1a6-e3ff-411b-9c24-3f26f01a2623 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125482024-12-18T22:27:19.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 590cb1a6-e3ff-411b-9c24-3f26f01a2623 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125492024-12-18T22:27:19.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 590cb1a6-e3ff-411b-9c24-3f26f01a2623 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125502024-12-18T22:27:20.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b6c6495-b299-4340-a694-d1569ce3c1b1 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125512024-12-18T22:27:20.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b6c6495-b299-4340-a694-d1569ce3c1b1 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125522024-12-18T22:27:20.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 9b6c6495-b299-4340-a694-d1569ce3c1b1 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125532024-12-18T22:27:21.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d6dff8cb-5840-40e6-8c49-d04dd1284195 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125542024-12-18T22:27:21.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d6dff8cb-5840-40e6-8c49-d04dd1284195 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125552024-12-18T22:27:21.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d6dff8cb-5840-40e6-8c49-d04dd1284195 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125562024-12-18T22:27:22.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c3b6b22c-aa18-4859-9b69-bcc718deb0e9 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125572024-12-18T22:27:22.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c3b6b22c-aa18-4859-9b69-bcc718deb0e9 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125582024-12-18T22:27:22.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = c3b6b22c-aa18-4859-9b69-bcc718deb0e9 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125592024-12-18T22:27:23.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39f8e624-cdbc-412b-8e78-8236b6aad61b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125602024-12-18T22:27:23.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39f8e624-cdbc-412b-8e78-8236b6aad61b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125612024-12-18T22:27:23.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39f8e624-cdbc-412b-8e78-8236b6aad61b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125622024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
125632024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
125642024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125652024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125662024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125672024-12-18T22:27:23.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125682024-12-18T22:27:23.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125692024-12-18T22:27:23.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125702024-12-18T22:27:23.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125712024-12-18T22:27:23.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125722024-12-18T22:27:23.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125732024-12-18T22:27:23.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.705842ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125742024-12-18T22:27:23.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125752024-12-18T22:27:23.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125762024-12-18T22:27:23.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125772024-12-18T22:27:23.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125782024-12-18T22:27:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
125792024-12-18T22:27:23.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125802024-12-18T22:27:23.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125812024-12-18T22:27:23.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
125822024-12-18T22:27:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.164116ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
125832024-12-18T22:27:24.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11eaa38d-a07a-40fb-8107-aa49a7b2a5bc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125842024-12-18T22:27:24.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11eaa38d-a07a-40fb-8107-aa49a7b2a5bc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125852024-12-18T22:27:24.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 11eaa38d-a07a-40fb-8107-aa49a7b2a5bc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125862024-12-18T22:27:25.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d006669-8321-4c60-8e4d-d01aec91b998 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125872024-12-18T22:27:25.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d006669-8321-4c60-8e4d-d01aec91b998 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125882024-12-18T22:27:25.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d006669-8321-4c60-8e4d-d01aec91b998 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125892024-12-18T22:27:26.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e79bdc57-6a53-4bfc-83cb-adeda8766154 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125902024-12-18T22:27:26.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e79bdc57-6a53-4bfc-83cb-adeda8766154 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125912024-12-18T22:27:26.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e79bdc57-6a53-4bfc-83cb-adeda8766154 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125922024-12-18T22:27:26.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5c4d9ded-2da2-447d-b0c8-81884f321d59 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
125932024-12-18T22:27:27.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcb8e60f-c0e8-4898-b447-fa05d03c154e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125942024-12-18T22:27:27.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcb8e60f-c0e8-4898-b447-fa05d03c154e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125952024-12-18T22:27:27.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = bcb8e60f-c0e8-4898-b447-fa05d03c154e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125962024-12-18T22:27:28.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b09e890e-10ae-49ba-abdf-0f1c48584acd roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125972024-12-18T22:27:28.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b09e890e-10ae-49ba-abdf-0f1c48584acd resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125982024-12-18T22:27:28.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = b09e890e-10ae-49ba-abdf-0f1c48584acd response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
125992024-12-18T22:27:29.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d798fd0-a0a3-424d-9d2b-2de210e5b2db roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126002024-12-18T22:27:29.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d798fd0-a0a3-424d-9d2b-2de210e5b2db resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126012024-12-18T22:27:29.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 3d798fd0-a0a3-424d-9d2b-2de210e5b2db response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126022024-12-18T22:27:30.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39361bd5-3edc-48a2-9194-d4cabf82ef3e roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126032024-12-18T22:27:30.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39361bd5-3edc-48a2-9194-d4cabf82ef3e resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126042024-12-18T22:27:30.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 39361bd5-3edc-48a2-9194-d4cabf82ef3e response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126052024-12-18T22:27:31.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = abb37995-27ef-4bb4-8824-208abed21ddc roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126062024-12-18T22:27:31.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = abb37995-27ef-4bb4-8824-208abed21ddc resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126072024-12-18T22:27:31.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = abb37995-27ef-4bb4-8824-208abed21ddc response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126082024-12-18T22:27:32.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 994b3e1a-fe4e-4af4-94d3-f558a22b7c40 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126092024-12-18T22:27:32.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 994b3e1a-fe4e-4af4-94d3-f558a22b7c40 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126102024-12-18T22:27:32.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 994b3e1a-fe4e-4af4-94d3-f558a22b7c40 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126112024-12-18T22:27:33.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e90491f6-cb5a-4ce0-9117-78b1ab0758b6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126122024-12-18T22:27:33.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e90491f6-cb5a-4ce0-9117-78b1ab0758b6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126132024-12-18T22:27:33.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = e90491f6-cb5a-4ce0-9117-78b1ab0758b6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126142024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
126152024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126162024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
126172024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126182024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126192024-12-18T22:27:33.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126202024-12-18T22:27:33.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126212024-12-18T22:27:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126222024-12-18T22:27:33.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126232024-12-18T22:27:33.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.685461ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126242024-12-18T22:27:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126252024-12-18T22:27:33.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126262024-12-18T22:27:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126272024-12-18T22:27:33.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126282024-12-18T22:27:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126292024-12-18T22:27:33.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126302024-12-18T22:27:33.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
126312024-12-18T22:27:33.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126322024-12-18T22:27:33.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126332024-12-18T22:27:33.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
126342024-12-18T22:27:33.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.704716ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
126352024-12-18T22:27:34.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3c3507-d6db-4144-9098-d8ab05b907e6 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126362024-12-18T22:27:34.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3c3507-d6db-4144-9098-d8ab05b907e6 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126372024-12-18T22:27:34.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 5b3c3507-d6db-4144-9098-d8ab05b907e6 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126382024-12-18T22:27:35.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 795a9eaa-270c-4558-ae46-e227ce7a3d3d roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126392024-12-18T22:27:35.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 795a9eaa-270c-4558-ae46-e227ce7a3d3d resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126402024-12-18T22:27:35.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 795a9eaa-270c-4558-ae46-e227ce7a3d3d response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126412024-12-18T22:27:36.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 5b12ad49-bb80-4fb6-a866-04151df60d47 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
126422024-12-18T22:27:36.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32e09844-30ec-4e13-988a-59353174d5ad roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126432024-12-18T22:27:36.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32e09844-30ec-4e13-988a-59353174d5ad resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126442024-12-18T22:27:36.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 32e09844-30ec-4e13-988a-59353174d5ad response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126452024-12-18T22:27:37.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d674606f-c935-4b49-97bd-49993ff110b2 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126462024-12-18T22:27:37.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d674606f-c935-4b49-97bd-49993ff110b2 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126472024-12-18T22:27:37.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = d674606f-c935-4b49-97bd-49993ff110b2 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126482024-12-18T22:27:38.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bf8046c-d440-45d6-9353-af58fc586e1a roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126492024-12-18T22:27:38.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bf8046c-d440-45d6-9353-af58fc586e1a resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126502024-12-18T22:27:38.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8bf8046c-d440-45d6-9353-af58fc586e1a response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126512024-12-18T22:27:39.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c3ca0f5-00b8-431c-adee-86d70c4d0690 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126522024-12-18T22:27:39.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c3ca0f5-00b8-431c-adee-86d70c4d0690 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126532024-12-18T22:27:39.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 4c3ca0f5-00b8-431c-adee-86d70c4d0690 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126542024-12-18T22:27:40.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5b6f493-c88b-4710-8ae8-c17c58529dd5 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126552024-12-18T22:27:40.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5b6f493-c88b-4710-8ae8-c17c58529dd5 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126562024-12-18T22:27:40.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = a5b6f493-c88b-4710-8ae8-c17c58529dd5 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126572024-12-18T22:27:41.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = eecc4385-d7f8-402a-a527-4496b83557f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
126582024-12-18T22:27:41.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = eecc4385-d7f8-402a-a527-4496b83557f4 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
126592024-12-18T22:27:41.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = eecc4385-d7f8-402a-a527-4496b83557f4 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?sort_by=id_ascending
126602024-12-18T22:27:41.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = ea467c8c-7cdb-4d1a-8094-b19ebad2d8f1 roles = RoleSet { roles: {} } uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
126612024-12-18T22:27:41.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = ea467c8c-7cdb-4d1a-8094-b19ebad2d8f1 resource = Database result = Ok(()) uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
126622024-12-18T22:27:41.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45569 req_id = ea467c8c-7cdb-4d1a-8094-b19ebad2d8f1 response_code = 200 uri = /metrics/collectors/6fd466f3-f0b4-4d40-b657-fd8a20eb0188/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMzhhZTkzMS1mZTM5LTQ3YTUtYTAzNi0xOTYzMDBjNmJiMjcifX0%3D
126632024-12-18T22:27:41.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fe2f7e-04ed-41d3-bf10-9ff0b8a38bab roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126642024-12-18T22:27:41.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fe2f7e-04ed-41d3-bf10-9ff0b8a38bab resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126652024-12-18T22:27:41.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fe2f7e-04ed-41d3-bf10-9ff0b8a38bab response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126662024-12-18T22:27:42.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 17bb1cb9-d7a0-4ea7-bcba-9e182f4c611b roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126672024-12-18T22:27:42.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 17bb1cb9-d7a0-4ea7-bcba-9e182f4c611b resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126682024-12-18T22:27:42.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 17bb1cb9-d7a0-4ea7-bcba-9e182f4c611b response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
126692024-12-18T22:27:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
126702024-12-18T22:27:43.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126712024-12-18T22:27:43.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
126722024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126732024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
126742024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126752024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
126762024-12-18T22:27:43.798ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126772024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
126782024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126792024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126802024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
126812024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
126822024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126832024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
126842024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
126852024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126862024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
126872024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
126882024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126892024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
126902024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126912024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
126922024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126932024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
126942024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126952024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
126962024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126972024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
126982024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126992024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127002024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
127012024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127022024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
127032024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127042024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
127052024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127062024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127072024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
127082024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127092024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127102024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127112024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127122024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127132024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127142024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
127152024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127162024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127172024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127182024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127192024-12-18T22:27:43.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127202024-12-18T22:27:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.663902ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
127212024-12-18T22:27:43.800ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.800735ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127222024-12-18T22:27:43.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127232024-12-18T22:27:43.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127242024-12-18T22:27:43.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127252024-12-18T22:27:43.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 419381778 } })
127262024-12-18T22:27:43.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
127272024-12-18T22:27:43.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127282024-12-18T22:27:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127292024-12-18T22:27:43.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127302024-12-18T22:27:43.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127312024-12-18T22:27:43.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127322024-12-18T22:27:43.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127332024-12-18T22:27:43.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127342024-12-18T22:27:43.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127352024-12-18T22:27:43.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127362024-12-18T22:27:43.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127372024-12-18T22:27:43.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127382024-12-18T22:27:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127392024-12-18T22:27:43.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127402024-12-18T22:27:43.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127412024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127422024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
127432024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127442024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127452024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127462024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127472024-12-18T22:27:43.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127482024-12-18T22:27:43.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 428386715 } })
127492024-12-18T22:27:43.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127502024-12-18T22:27:43.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
127512024-12-18T22:27:43.812ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127522024-12-18T22:27:43.812ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
127532024-12-18T22:27:43.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127542024-12-18T22:27:43.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.372032ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127552024-12-18T22:27:43.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127562024-12-18T22:27:43.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-44b7e384-368a-4bb9-a5b4-e1c12506ebd3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 430163479 } })
127572024-12-18T22:27:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127582024-12-18T22:27:43.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127592024-12-18T22:27:43.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
127602024-12-18T22:27:43.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127612024-12-18T22:27:43.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127622024-12-18T22:27:43.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127632024-12-18T22:27:43.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127642024-12-18T22:27:43.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127652024-12-18T22:27:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127662024-12-18T22:27:43.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127672024-12-18T22:27:43.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127682024-12-18T22:27:43.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127692024-12-18T22:27:43.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127702024-12-18T22:27:43.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127712024-12-18T22:27:43.820ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127722024-12-18T22:27:43.820ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127732024-12-18T22:27:43.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127742024-12-18T22:27:43.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127752024-12-18T22:27:43.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127762024-12-18T22:27:43.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127772024-12-18T22:27:43.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127782024-12-18T22:27:43.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127792024-12-18T22:27:43.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127802024-12-18T22:27:43.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127812024-12-18T22:27:43.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.602836ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
127822024-12-18T22:27:43.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127832024-12-18T22:27:43.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127842024-12-18T22:27:43.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127852024-12-18T22:27:43.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127862024-12-18T22:27:43.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127872024-12-18T22:27:43.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.830438ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
127882024-12-18T22:27:43.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127892024-12-18T22:27:43.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127902024-12-18T22:27:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 44b7e384-368a-4bb9-a5b4-e1c12506ebd3, lookup_type: ById(44b7e384-368a-4bb9-a5b4-e1c12506ebd3) } result = Ok(())
127912024-12-18T22:27:43.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127922024-12-18T22:27:43.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127932024-12-18T22:27:43.851ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127942024-12-18T22:27:43.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.869998ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
127952024-12-18T22:27:43.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127962024-12-18T22:27:43.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127972024-12-18T22:27:43.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127982024-12-18T22:27:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bc275d65-7e76-4203-bf4b-e65abfaa3705, lookup_type: ById(bc275d65-7e76-4203-bf4b-e65abfaa3705) } result = Ok(())
127992024-12-18T22:27:43.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128002024-12-18T22:27:43.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128012024-12-18T22:27:43.861ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.560247ms iteration = 28 status = 0
128022024-12-18T22:27:43.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 63.867753ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
128032024-12-18T22:27:43.863ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128042024-12-18T22:27:43.863ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128052024-12-18T22:27:43.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 65.212169ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128062024-12-18T22:27:43.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
128072024-12-18T22:27:43.867ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128082024-12-18T22:27:43.868ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f28cb6a8-47c7-45cf-b007-4a2a7861b390", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128092024-12-18T22:27:43.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128102024-12-18T22:27:43.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128112024-12-18T22:27:43.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 original_time_created = 2024-12-18 22:14:03.411278 UTC target_id = bc275d65-7e76-4203-bf4b-e65abfaa3705 time_created = 2024-12-18 22:14:03.411278 UTC
128122024-12-18T22:27:43.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.423631ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"bc275d65-7e76-4203-bf4b-e65abfaa3705","time_created":"2024-12-18T22:14:03.411278Z"}
128132024-12-18T22:27:43.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.497591ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128142024-12-18T22:27:43.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8abc553b-cad2-4482-99e9-25019f482c64 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
128152024-12-18T22:27:43.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8abc553b-cad2-4482-99e9-25019f482c64 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
128162024-12-18T22:27:43.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 8abc553b-cad2-4482-99e9-25019f482c64 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
128172024-12-18T22:27:43.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
128182024-12-18T22:27:43.888ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128192024-12-18T22:27:43.888ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c516e57-5b31-4fc5-b1e7-565c57787404", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128202024-12-18T22:27:43.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128212024-12-18T22:27:43.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128222024-12-18T22:27:43.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 zone_address = fd00:1122:3344:101::2
128232024-12-18T22:27:43.914ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128242024-12-18T22:27:43.914ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab3f004-d786-40d8-b479-2ced4d94dfc4", "content-length": "26", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128252024-12-18T22:27:43.914ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128262024-12-18T22:27:43.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
128272024-12-18T22:27:43.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128282024-12-18T22:27:43.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128292024-12-18T22:27:43.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128302024-12-18T22:27:43.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128312024-12-18T22:27:43.928ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.184964ms iteration = 31 status = {"physical_disks_added":0}
128322024-12-18T22:27:43.952ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
128332024-12-18T22:27:43.952ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec417040-c355-4eda-920d-30c8a290ff4b", "content-length": "2", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128342024-12-18T22:27:43.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128352024-12-18T22:27:43.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128362024-12-18T22:27:43.974ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128372024-12-18T22:27:43.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128382024-12-18T22:27:43.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8d5336e-8695-46cf-bdc7-9afdbc3486af", "content-length": "372", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128392024-12-18T22:27:43.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128402024-12-18T22:27:43.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128412024-12-18T22:27:43.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128422024-12-18T22:27:43.977ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.190736ms iteration = 28 status = null
128432024-12-18T22:27:43.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128442024-12-18T22:27:43.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128452024-12-18T22:27:43.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128462024-12-18T22:27:43.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128472024-12-18T22:27:43.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128482024-12-18T22:27:43.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128492024-12-18T22:27:43.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128502024-12-18T22:27:43.983ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.192964ms iteration = 28 status = {}
128512024-12-18T22:27:44.012ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
128522024-12-18T22:27:44.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128532024-12-18T22:27:44.013ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70dde540-ab76-4e67-b9fd-78d1be5531ec", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128542024-12-18T22:27:44.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128552024-12-18T22:27:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128562024-12-18T22:27:44.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128572024-12-18T22:27:44.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128582024-12-18T22:27:44.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128592024-12-18T22:27:44.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128602024-12-18T22:27:44.022ZINFOnexus (BackgroundTasks): VPC route manager sled 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128612024-12-18T22:27:44.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128622024-12-18T22:27:44.022ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fa331568-2321-4036-bc2f-25226f39a248", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128632024-12-18T22:27:44.023ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 225.718319ms iteration = 29 status = {}
128642024-12-18T22:27:44.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128652024-12-18T22:27:44.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 44b7e384-368a-4bb9-a5b4-e1c12506ebd3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa196dbf-2b21-4ca7-aae4-e25d7d694cd0", "content-length": "691", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128662024-12-18T22:27:44.048ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
128672024-12-18T22:27:44.048ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
128682024-12-18T22:27:44.048ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
128692024-12-18T22:27:44.050ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 252.558885ms iteration = 29 status = {}
128702024-12-18T22:27:44.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128712024-12-18T22:27:44.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128722024-12-18T22:27:44.081ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c03a2de0-7632-4cd4-93d9-aba98f2c0f7e, rack_id: cb51312e-7ab9-47f9-9ff4-bd0991c68cd7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b) } rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
128732024-12-18T22:27:44.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128742024-12-18T22:27:44.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128752024-12-18T22:27:44.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
128762024-12-18T22:27:44.093ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dfd7e36-87ae-4507-98fa-9d89617f8e91", "content-length": "134", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128772024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
128782024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2e6a1d34-b13f-48ed-ac68-ebbf1c72f43b
128792024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
128802024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
128812024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128822024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128832024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128842024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128852024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128862024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128872024-12-18T22:27:44.093ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7
128882024-12-18T22:27:44.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128892024-12-18T22:27:44.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128902024-12-18T22:27:44.095ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
128912024-12-18T22:27:44.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "05960439-680d-4665-939d-b8fb77dd7de1", "content-length": "2", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128922024-12-18T22:27:44.096ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
128932024-12-18T22:27:44.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "35889c68-2847-4dae-80f5-e21c9eec9845", "content-length": "52", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128942024-12-18T22:27:44.096ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch_location = Switch0
128952024-12-18T22:27:44.096ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
128962024-12-18T22:27:44.196ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8d9749e8-7d87-4ccd-b93e-8fc310978139", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
128972024-12-18T22:27:44.196ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 switch = Switch0
128982024-12-18T22:27:44.196ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
128992024-12-18T22:27:44.197ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cb51312e-7ab9-47f9-9ff4-bd0991c68cd7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f9027de-2054-428e-ac03-54edee7353a2", "content-length": "682", "date": "Wed, 18 Dec 2024 22:27:43 GMT"} })
129002024-12-18T22:27:44.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129012024-12-18T22:27:44.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129022024-12-18T22:27:44.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129032024-12-18T22:27:44.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129042024-12-18T22:27:44.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129052024-12-18T22:27:44.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129062024-12-18T22:27:44.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129072024-12-18T22:27:44.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129082024-12-18T22:27:44.212ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 414.914561ms iteration = 28 status = {}
129092024-12-18T22:27:44.648ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
129102024-12-18T22:27:44.648ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
129112024-12-18T22:27:44.678ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
129122024-12-18T22:27:44.678ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63808
129132024-12-18T22:27:44.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63808 req_id = 4409f2e1-47fe-4c9f-bab3-52c13ecd9bb5 roles = RoleSet { roles: {} } uri = /metrics/producers
129142024-12-18T22:27:44.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63808 req_id = 4409f2e1-47fe-4c9f-bab3-52c13ecd9bb5 resource = Database result = Ok(()) uri = /metrics/producers
129152024-12-18T22:27:44.715ZINFOnexus: assigned collector to new producer collector_id = 6fd466f3-f0b4-4d40-b657-fd8a20eb0188 file = nexus/src/app/oximeter.rs:76 producer_id = 9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
129162024-12-18T22:27:44.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36907 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63808 req_id = 4409f2e1-47fe-4c9f-bab3-52c13ecd9bb5 response_code = 201 uri = /metrics/producers
129172024-12-18T22:27:44.715ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4409f2e1-47fe-4c9f-bab3-52c13ecd9bb5", "content-length": "41", "date": "Wed, 18 Dec 2024 22:27:44 GMT"} })
129182024-12-18T22:27:44.717ZDEBGnexus (producer-registration-task): registered with nexus successfully
129192024-12-18T22:27:44.717ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
129202024-12-18T22:27:44.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fd2902-724c-4490-8eac-e1f1f3a843aa roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129212024-12-18T22:27:44.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fd2902-724c-4490-8eac-e1f1f3a843aa resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129222024-12-18T22:27:44.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 76fd2902-724c-4490-8eac-e1f1f3a843aa response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129232024-12-18T22:27:45.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ef6710cd-5acb-4b72-b41b-1e1a7e077846 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129242024-12-18T22:27:45.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ef6710cd-5acb-4b72-b41b-1e1a7e077846 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129252024-12-18T22:27:45.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ef6710cd-5acb-4b72-b41b-1e1a7e077846 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129262024-12-18T22:27:46.636ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:55337 method = GET remote_addr = [fd00:1122:3344:101::d]:52098 req_id = 69a51680-b4ba-419b-83d2-79bf3c81fd73 response_code = 200 uri = /9f269ac0-3a79-44fd-9bc5-1f6f5cdfd395
129272024-12-18T22:27:46.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27e1f458-9703-4367-9ec2-a0536a399187 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129282024-12-18T22:27:46.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27e1f458-9703-4367-9ec2-a0536a399187 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129292024-12-18T22:27:46.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = 27e1f458-9703-4367-9ec2-a0536a399187 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129302024-12-18T22:27:47.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2070e9b8-e040-4094-91b7-98f9b7bf65f4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
129312024-12-18T22:27:47.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2070e9b8-e040-4094-91b7-98f9b7bf65f4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
129322024-12-18T22:27:47.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43701 req_id = 2070e9b8-e040-4094-91b7-98f9b7bf65f4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
129332024-12-18T22:27:47.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca3764bc-8e44-4f1e-be39-a173c6228725 roles = RoleSet { roles: {} } uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129342024-12-18T22:27:47.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca3764bc-8e44-4f1e-be39-a173c6228725 resource = Database result = Ok(()) uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3
129352024-12-18T22:27:47.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:38590 req_id = ca3764bc-8e44-4f1e-be39-a173c6228725 response_code = 200 uri = /probes/44b7e384-368a-4bb9-a5b4-e1c12506ebd3