Max level shown:
12025-01-17T08:30:01.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 38818402-17b9-49b5-be71-6d80a8cb7ca1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22025-01-17T08:30:01.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 38818402-17b9-49b5-be71-6d80a8cb7ca1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32025-01-17T08:30:01.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 38818402-17b9-49b5-be71-6d80a8cb7ca1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
42025-01-17T08:30:01.881ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
52025-01-17T08:30:01.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62025-01-17T08:30:01.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72025-01-17T08:30:01.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82025-01-17T08:30:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92025-01-17T08:30:01.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102025-01-17T08:30:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112025-01-17T08:30:01.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
122025-01-17T08:30:01.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132025-01-17T08:30:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142025-01-17T08:30:01.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152025-01-17T08:30:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162025-01-17T08:30:01.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
172025-01-17T08:30:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182025-01-17T08:30:01.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
192025-01-17T08:30:01.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.593968ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
202025-01-17T08:30:01.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
212025-01-17T08:30:01.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222025-01-17T08:30:01.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232025-01-17T08:30:01.904ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
242025-01-17T08:30:01.904ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.485618ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
252025-01-17T08:30:02.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2a4bc2fe-0784-4a30-9c30-1aa095a289f6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
262025-01-17T08:30:02.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2a4bc2fe-0784-4a30-9c30-1aa095a289f6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
272025-01-17T08:30:02.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2a4bc2fe-0784-4a30-9c30-1aa095a289f6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
282025-01-17T08:30:03.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4b17e591-58b0-47b4-8c1c-0daea0209014 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
292025-01-17T08:30:03.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4b17e591-58b0-47b4-8c1c-0daea0209014 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
302025-01-17T08:30:03.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4b17e591-58b0-47b4-8c1c-0daea0209014 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
312025-01-17T08:30:03.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = c8146098-f54c-4bbe-bd56-8010f2b809fb response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
322025-01-17T08:30:04.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 35a4217f-28fb-4a76-9a89-c3a7b802b6c4 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
332025-01-17T08:30:04.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 35a4217f-28fb-4a76-9a89-c3a7b802b6c4 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
342025-01-17T08:30:04.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 35a4217f-28fb-4a76-9a89-c3a7b802b6c4 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
352025-01-17T08:30:05.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2fae6665-8091-43e5-925f-232baf14bc2e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
362025-01-17T08:30:05.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2fae6665-8091-43e5-925f-232baf14bc2e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
372025-01-17T08:30:05.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2fae6665-8091-43e5-925f-232baf14bc2e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
382025-01-17T08:30:06.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cb00fe13-117c-4358-b510-4d13218371dd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
392025-01-17T08:30:06.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cb00fe13-117c-4358-b510-4d13218371dd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
402025-01-17T08:30:06.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cb00fe13-117c-4358-b510-4d13218371dd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
412025-01-17T08:30:07.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 676912e1-5d92-4aed-8ab2-722030558714 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
422025-01-17T08:30:07.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 676912e1-5d92-4aed-8ab2-722030558714 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
432025-01-17T08:30:07.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 676912e1-5d92-4aed-8ab2-722030558714 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
442025-01-17T08:30:08.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06392455-25a7-4a40-b9ba-415384addf73 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
452025-01-17T08:30:08.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06392455-25a7-4a40-b9ba-415384addf73 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
462025-01-17T08:30:08.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06392455-25a7-4a40-b9ba-415384addf73 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
472025-01-17T08:30:08.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = 6c0f9185-0a38-4eb9-8230-ddf7fb774934 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
482025-01-17T08:30:08.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = 6c0f9185-0a38-4eb9-8230-ddf7fb774934 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
492025-01-17T08:30:08.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3764 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = 6c0f9185-0a38-4eb9-8230-ddf7fb774934 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
502025-01-17T08:30:08.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = fc93f427-ff52-47bc-aa35-1cde48240ac0 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
512025-01-17T08:30:08.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = fc93f427-ff52-47bc-aa35-1cde48240ac0 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
522025-01-17T08:30:08.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44121 req_id = fc93f427-ff52-47bc-aa35-1cde48240ac0 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
532025-01-17T08:30:09.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a04dfb32-b11f-43e1-a754-b0dc6669e0fe roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
542025-01-17T08:30:09.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a04dfb32-b11f-43e1-a754-b0dc6669e0fe resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
552025-01-17T08:30:09.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a04dfb32-b11f-43e1-a754-b0dc6669e0fe response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
562025-01-17T08:30:10.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b28e92ec-0be7-4b7f-9659-470280819653 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
572025-01-17T08:30:10.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b28e92ec-0be7-4b7f-9659-470280819653 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
582025-01-17T08:30:10.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b28e92ec-0be7-4b7f-9659-470280819653 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
592025-01-17T08:30:11.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a3eab781-aad2-4db7-8c5f-488b5c872dd2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
602025-01-17T08:30:11.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a3eab781-aad2-4db7-8c5f-488b5c872dd2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
612025-01-17T08:30:11.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a3eab781-aad2-4db7-8c5f-488b5c872dd2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
622025-01-17T08:30:11.881ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
632025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
642025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
652025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
662025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
672025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
682025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
692025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
702025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
712025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
722025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
732025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
742025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
752025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
762025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
772025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
782025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
792025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
802025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
812025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
822025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
832025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
842025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
852025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
862025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
872025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
882025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
892025-01-17T08:30:11.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
902025-01-17T08:30:11.883ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
912025-01-17T08:30:11.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
922025-01-17T08:30:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
932025-01-17T08:30:11.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
942025-01-17T08:30:11.885ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.990074ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
952025-01-17T08:30:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
962025-01-17T08:30:11.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
972025-01-17T08:30:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
982025-01-17T08:30:11.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 64028124 } })
992025-01-17T08:30:11.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
1002025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
1012025-01-17T08:30:11.887ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1022025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1032025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
1042025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1052025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
1062025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1072025-01-17T08:30:11.887ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1082025-01-17T08:30:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1092025-01-17T08:30:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1102025-01-17T08:30:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1112025-01-17T08:30:11.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1122025-01-17T08:30:11.889ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 66173021 } })
1132025-01-17T08:30:11.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
1142025-01-17T08:30:11.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1152025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1162025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1172025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1182025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
1192025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
1202025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1212025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1222025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
1232025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1242025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
1252025-01-17T08:30:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1262025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1272025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1282025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1292025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1302025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1312025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1322025-01-17T08:30:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1332025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1342025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1352025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1362025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1372025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1382025-01-17T08:30:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1392025-01-17T08:30:11.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1402025-01-17T08:30:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1412025-01-17T08:30:11.896ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 73383018 } })
1422025-01-17T08:30:11.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
1432025-01-17T08:30:11.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1442025-01-17T08:30:11.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1452025-01-17T08:30:11.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1462025-01-17T08:30:11.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1472025-01-17T08:30:11.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1482025-01-17T08:30:11.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1492025-01-17T08:30:11.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1502025-01-17T08:30:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1512025-01-17T08:30:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1522025-01-17T08:30:11.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1532025-01-17T08:30:11.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1542025-01-17T08:30:11.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1552025-01-17T08:30:11.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1562025-01-17T08:30:11.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1572025-01-17T08:30:11.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1582025-01-17T08:30:11.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1592025-01-17T08:30:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1602025-01-17T08:30:11.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.038311ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
1612025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.480974ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
1622025-01-17T08:30:11.939ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1632025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1642025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1652025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1662025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1672025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1682025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1692025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1702025-01-17T08:30:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1712025-01-17T08:30:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1722025-01-17T08:30:11.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1732025-01-17T08:30:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1742025-01-17T08:30:11.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
1752025-01-17T08:30:11.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762025-01-17T08:30:11.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1772025-01-17T08:30:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782025-01-17T08:30:11.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792025-01-17T08:30:11.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1802025-01-17T08:30:11.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
1812025-01-17T08:30:11.946ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1822025-01-17T08:30:11.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1832025-01-17T08:30:11.947ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2f8f535-0c85-4f7f-8170-d5c922b8c2f5", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
1842025-01-17T08:30:11.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1852025-01-17T08:30:11.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1862025-01-17T08:30:11.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1872025-01-17T08:30:11.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1882025-01-17T08:30:11.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1892025-01-17T08:30:11.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1902025-01-17T08:30:11.949ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1912025-01-17T08:30:11.949ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1922025-01-17T08:30:11.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1932025-01-17T08:30:11.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1942025-01-17T08:30:11.953ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1952025-01-17T08:30:11.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.324506ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1962025-01-17T08:30:11.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
1972025-01-17T08:30:11.957ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1982025-01-17T08:30:11.957ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8f65183-603b-4181-9d80-0dc0964213e4", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
1992025-01-17T08:30:11.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2002025-01-17T08:30:11.958ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
2012025-01-17T08:30:11.958ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2022025-01-17T08:30:11.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2f8096-37c5-4bf5-af60-4abb3d9f5c4e", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2032025-01-17T08:30:11.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2042025-01-17T08:30:11.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2052025-01-17T08:30:11.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
2062025-01-17T08:30:11.962ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
2072025-01-17T08:30:11.962ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.225105ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
2082025-01-17T08:30:11.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2092025-01-17T08:30:11.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2102025-01-17T08:30:11.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2112025-01-17T08:30:11.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2122025-01-17T08:30:11.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132025-01-17T08:30:11.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
2142025-01-17T08:30:11.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2152025-01-17T08:30:11.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2162025-01-17T08:30:11.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2172025-01-17T08:30:11.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2182025-01-17T08:30:11.973ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.642465ms iteration = 14 status = 0
2192025-01-17T08:30:11.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.83998ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2202025-01-17T08:30:11.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212025-01-17T08:30:11.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2222025-01-17T08:30:11.975ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2232025-01-17T08:30:11.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2242025-01-17T08:30:11.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2252025-01-17T08:30:11.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2262025-01-17T08:30:11.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.223593ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2272025-01-17T08:30:11.978ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.488102ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2282025-01-17T08:30:11.981ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2292025-01-17T08:30:11.981ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2302025-01-17T08:30:11.981ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.888523ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2312025-01-17T08:30:11.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.324034ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2322025-01-17T08:30:12.007ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
2332025-01-17T08:30:12.007ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 125.726685ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2342025-01-17T08:30:12.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2352025-01-17T08:30:12.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2362025-01-17T08:30:12.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372025-01-17T08:30:12.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2382025-01-17T08:30:12.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2392025-01-17T08:30:12.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2402025-01-17T08:30:12.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412025-01-17T08:30:12.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2422025-01-17T08:30:12.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2432025-01-17T08:30:12.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2442025-01-17T08:30:12.044ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.318444ms iteration = 16 status = {"physical_disks_added":0}
2452025-01-17T08:30:12.051ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2462025-01-17T08:30:12.052ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae2318d1-e42d-4fc4-a224-f3c71be6393e", "content-length": "1", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2472025-01-17T08:30:12.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2482025-01-17T08:30:12.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2492025-01-17T08:30:12.103ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2502025-01-17T08:30:12.103ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2512025-01-17T08:30:12.103ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8418934b-0326-4a66-adb1-c232cae1da6e", "content-length": "372", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2522025-01-17T08:30:12.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2532025-01-17T08:30:12.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2542025-01-17T08:30:12.106ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.265135ms iteration = 14 status = null
2552025-01-17T08:30:12.119ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.901114ms iteration = 14 status = {}
2562025-01-17T08:30:12.145ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2572025-01-17T08:30:12.145ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2582025-01-17T08:30:12.145ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60c76eee-4029-4db9-8c07-98df2f8f1a7f", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2592025-01-17T08:30:12.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2602025-01-17T08:30:12.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2612025-01-17T08:30:12.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2622025-01-17T08:30:12.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2632025-01-17T08:30:12.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2642025-01-17T08:30:12.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2652025-01-17T08:30:12.157ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2662025-01-17T08:30:12.157ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2672025-01-17T08:30:12.157ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c03686cf-3b13-4dd2-a9e7-2b18ff9eb654", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2682025-01-17T08:30:12.159ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.63769ms iteration = 14 status = {}
2692025-01-17T08:30:12.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2702025-01-17T08:30:12.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2712025-01-17T08:30:12.196ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
2722025-01-17T08:30:12.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2732025-01-17T08:30:12.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2742025-01-17T08:30:12.201ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2752025-01-17T08:30:12.201ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "63904dd0-9cbd-4a11-8b34-775ba35d6cca", "content-length": "691", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2762025-01-17T08:30:12.201ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2772025-01-17T08:30:12.202ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2782025-01-17T08:30:12.202ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2792025-01-17T08:30:12.202ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.870659ms iteration = 14 status = {}
2802025-01-17T08:30:12.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2812025-01-17T08:30:12.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcea45ad-0278-47b5-b1bf-c9b218ab74dc", "content-length": "134", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2822025-01-17T08:30:12.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2832025-01-17T08:30:12.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
2842025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2852025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2862025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2872025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2882025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2892025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2902025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2912025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2922025-01-17T08:30:12.205ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
2932025-01-17T08:30:12.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2942025-01-17T08:30:12.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2952025-01-17T08:30:12.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2962025-01-17T08:30:12.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4501e839-f4fd-47ae-af66-bc4dcba16bea", "content-length": "2", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2972025-01-17T08:30:12.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2982025-01-17T08:30:12.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d0e1f4c-b097-49d1-89b6-9f9e08e1076c", "content-length": "52", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
2992025-01-17T08:30:12.207ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
3002025-01-17T08:30:12.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3012025-01-17T08:30:12.303ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a5795b58-f574-4116-8f8e-1d0167ef3f58", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
3022025-01-17T08:30:12.304ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
3032025-01-17T08:30:12.304ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3042025-01-17T08:30:12.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "551650eb-e140-4d13-b428-7899446d2444", "content-length": "682", "date": "Fri, 17 Jan 2025 08:30:11 GMT"} })
3052025-01-17T08:30:12.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3062025-01-17T08:30:12.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3072025-01-17T08:30:12.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3082025-01-17T08:30:12.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3092025-01-17T08:30:12.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3102025-01-17T08:30:12.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3112025-01-17T08:30:12.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3122025-01-17T08:30:12.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3132025-01-17T08:30:12.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5aea5001-f2de-492a-8511-f1ca9efe21c7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3142025-01-17T08:30:12.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5aea5001-f2de-492a-8511-f1ca9efe21c7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3152025-01-17T08:30:12.320ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.252888ms iteration = 14 status = {}
3162025-01-17T08:30:12.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5aea5001-f2de-492a-8511-f1ca9efe21c7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3172025-01-17T08:30:13.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7fd5ba08-7ef9-4635-b384-1b5eb7f5728f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3182025-01-17T08:30:13.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7fd5ba08-7ef9-4635-b384-1b5eb7f5728f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3192025-01-17T08:30:13.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7fd5ba08-7ef9-4635-b384-1b5eb7f5728f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3202025-01-17T08:30:13.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dbc43fe-bc51-4c0b-b6a0-2e202f3f5c90 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3212025-01-17T08:30:13.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dbc43fe-bc51-4c0b-b6a0-2e202f3f5c90 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3222025-01-17T08:30:13.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dbc43fe-bc51-4c0b-b6a0-2e202f3f5c90 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3232025-01-17T08:30:13.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 81590298-0071-4277-ae7d-dbd311e0e62a response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
3242025-01-17T08:30:14.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51c74bc6-069d-4462-97a2-22a891ee883e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3252025-01-17T08:30:14.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51c74bc6-069d-4462-97a2-22a891ee883e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3262025-01-17T08:30:14.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51c74bc6-069d-4462-97a2-22a891ee883e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3272025-01-17T08:30:15.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dbb2b29-eb2e-4fff-af04-b0d33bcad6d7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3282025-01-17T08:30:15.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dbb2b29-eb2e-4fff-af04-b0d33bcad6d7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3292025-01-17T08:30:15.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dbb2b29-eb2e-4fff-af04-b0d33bcad6d7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3302025-01-17T08:30:16.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f543e2db-49d3-4f63-bb44-0c9f70b3f609 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3312025-01-17T08:30:16.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f543e2db-49d3-4f63-bb44-0c9f70b3f609 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3322025-01-17T08:30:16.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f543e2db-49d3-4f63-bb44-0c9f70b3f609 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3332025-01-17T08:30:17.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ff5afdb-c1aa-4602-8bdb-5a34dc9af700 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3342025-01-17T08:30:17.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ff5afdb-c1aa-4602-8bdb-5a34dc9af700 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3352025-01-17T08:30:17.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ff5afdb-c1aa-4602-8bdb-5a34dc9af700 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3362025-01-17T08:30:18.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 404a6f5b-1153-4e01-86d5-1957833b9893 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3372025-01-17T08:30:18.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 404a6f5b-1153-4e01-86d5-1957833b9893 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3382025-01-17T08:30:18.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 404a6f5b-1153-4e01-86d5-1957833b9893 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3392025-01-17T08:30:19.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1de80ba-1ca1-468b-97eb-752e5c046211 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3402025-01-17T08:30:19.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1de80ba-1ca1-468b-97eb-752e5c046211 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3412025-01-17T08:30:19.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1de80ba-1ca1-468b-97eb-752e5c046211 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3422025-01-17T08:30:20.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e97f056a-fe8b-4755-8250-24973e969cb2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3432025-01-17T08:30:20.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e97f056a-fe8b-4755-8250-24973e969cb2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3442025-01-17T08:30:20.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2739 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e97f056a-fe8b-4755-8250-24973e969cb2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3452025-01-17T08:30:21.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f958aa87-2c47-4be4-8f82-edd49b1136b7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3462025-01-17T08:30:21.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f958aa87-2c47-4be4-8f82-edd49b1136b7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3472025-01-17T08:30:21.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f958aa87-2c47-4be4-8f82-edd49b1136b7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3482025-01-17T08:30:21.881ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
3492025-01-17T08:30:21.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3502025-01-17T08:30:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3512025-01-17T08:30:21.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522025-01-17T08:30:21.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3532025-01-17T08:30:21.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3542025-01-17T08:30:21.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3552025-01-17T08:30:21.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3562025-01-17T08:30:21.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
3572025-01-17T08:30:21.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3582025-01-17T08:30:21.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3592025-01-17T08:30:21.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3602025-01-17T08:30:21.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3612025-01-17T08:30:21.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3622025-01-17T08:30:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3632025-01-17T08:30:21.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.627979ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3642025-01-17T08:30:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
3652025-01-17T08:30:21.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3662025-01-17T08:30:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3672025-01-17T08:30:21.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
3682025-01-17T08:30:21.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.152861ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
3692025-01-17T08:30:22.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e483e840-3b57-41b3-813b-b9614a978a8f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3702025-01-17T08:30:22.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e483e840-3b57-41b3-813b-b9614a978a8f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3712025-01-17T08:30:22.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e483e840-3b57-41b3-813b-b9614a978a8f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3722025-01-17T08:30:23.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 9123c7be-890c-46b0-abc8-8b84ca4bd82f response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
3732025-01-17T08:30:23.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d04d7ef-affc-464e-9379-0b9c6a6b1699 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3742025-01-17T08:30:23.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d04d7ef-affc-464e-9379-0b9c6a6b1699 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3752025-01-17T08:30:23.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d04d7ef-affc-464e-9379-0b9c6a6b1699 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3762025-01-17T08:30:24.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 055ec08c-0837-4208-936d-16d004c13092 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3772025-01-17T08:30:24.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 055ec08c-0837-4208-936d-16d004c13092 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3782025-01-17T08:30:24.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 055ec08c-0837-4208-936d-16d004c13092 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3792025-01-17T08:30:25.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36e73d30-4c02-46d7-9e3b-e5a92c72ce8d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3802025-01-17T08:30:25.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36e73d30-4c02-46d7-9e3b-e5a92c72ce8d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3812025-01-17T08:30:25.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36e73d30-4c02-46d7-9e3b-e5a92c72ce8d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3822025-01-17T08:30:26.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0dd4174-2a81-4709-870d-21aea66e0c91 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3832025-01-17T08:30:26.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0dd4174-2a81-4709-870d-21aea66e0c91 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3842025-01-17T08:30:26.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0dd4174-2a81-4709-870d-21aea66e0c91 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3852025-01-17T08:30:27.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 901a38e1-1a8b-40e9-8d5d-84fa27ec1b8c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3862025-01-17T08:30:27.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 901a38e1-1a8b-40e9-8d5d-84fa27ec1b8c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3872025-01-17T08:30:27.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 901a38e1-1a8b-40e9-8d5d-84fa27ec1b8c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3882025-01-17T08:30:28.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32ce3eae-c598-4798-9ea8-dc4ea30bed53 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3892025-01-17T08:30:28.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32ce3eae-c598-4798-9ea8-dc4ea30bed53 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3902025-01-17T08:30:28.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32ce3eae-c598-4798-9ea8-dc4ea30bed53 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3912025-01-17T08:30:29.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aecd48b4-9b50-4f4b-b329-9b745233c597 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3922025-01-17T08:30:29.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aecd48b4-9b50-4f4b-b329-9b745233c597 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3932025-01-17T08:30:29.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aecd48b4-9b50-4f4b-b329-9b745233c597 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3942025-01-17T08:30:30.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7016fb40-41cb-440e-9052-448b2e73346e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3952025-01-17T08:30:30.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7016fb40-41cb-440e-9052-448b2e73346e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3962025-01-17T08:30:30.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7016fb40-41cb-440e-9052-448b2e73346e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3972025-01-17T08:30:31.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8762eae-d7bc-41dc-a559-2c95be57130d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3982025-01-17T08:30:31.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8762eae-d7bc-41dc-a559-2c95be57130d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3992025-01-17T08:30:31.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8762eae-d7bc-41dc-a559-2c95be57130d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4002025-01-17T08:30:31.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
4012025-01-17T08:30:31.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4022025-01-17T08:30:31.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4032025-01-17T08:30:31.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4042025-01-17T08:30:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4052025-01-17T08:30:31.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4062025-01-17T08:30:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4072025-01-17T08:30:31.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
4082025-01-17T08:30:31.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4092025-01-17T08:30:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4102025-01-17T08:30:31.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4112025-01-17T08:30:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4122025-01-17T08:30:31.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4132025-01-17T08:30:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4142025-01-17T08:30:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4152025-01-17T08:30:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
4162025-01-17T08:30:31.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4172025-01-17T08:30:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4182025-01-17T08:30:31.904ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
4192025-01-17T08:30:31.904ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.226276ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
4202025-01-17T08:30:31.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.219135ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4212025-01-17T08:30:32.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92855e2a-097c-45c4-8e71-5a0513c7beab roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4222025-01-17T08:30:32.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92855e2a-097c-45c4-8e71-5a0513c7beab resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4232025-01-17T08:30:32.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92855e2a-097c-45c4-8e71-5a0513c7beab response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4242025-01-17T08:30:33.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 2e69abfb-7744-43a6-920d-d9868418f1e6 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
4252025-01-17T08:30:33.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33998c82-bf1c-4a67-a081-c85868f3cb68 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4262025-01-17T08:30:33.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33998c82-bf1c-4a67-a081-c85868f3cb68 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4272025-01-17T08:30:33.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33998c82-bf1c-4a67-a081-c85868f3cb68 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4282025-01-17T08:30:34.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc307399-bc3e-400f-85b8-5c1e0eb0daef roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4292025-01-17T08:30:34.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc307399-bc3e-400f-85b8-5c1e0eb0daef resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4302025-01-17T08:30:34.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc307399-bc3e-400f-85b8-5c1e0eb0daef response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4312025-01-17T08:30:35.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 66d1f2a4-22e1-42c5-8c8a-d4de689b0dbb roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4322025-01-17T08:30:35.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 66d1f2a4-22e1-42c5-8c8a-d4de689b0dbb resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4332025-01-17T08:30:35.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3997 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 66d1f2a4-22e1-42c5-8c8a-d4de689b0dbb response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4342025-01-17T08:30:36.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e0876028-755d-473c-beb7-244ea7f36888 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4352025-01-17T08:30:36.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e0876028-755d-473c-beb7-244ea7f36888 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4362025-01-17T08:30:36.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e0876028-755d-473c-beb7-244ea7f36888 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4372025-01-17T08:30:37.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21ab9d93-55a4-4a79-a85a-49f3f6262380 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4382025-01-17T08:30:37.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21ab9d93-55a4-4a79-a85a-49f3f6262380 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4392025-01-17T08:30:37.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21ab9d93-55a4-4a79-a85a-49f3f6262380 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4402025-01-17T08:30:38.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 203709dd-c38c-4b96-ba21-a927d763fdda roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4412025-01-17T08:30:38.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 203709dd-c38c-4b96-ba21-a927d763fdda resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4422025-01-17T08:30:38.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 203709dd-c38c-4b96-ba21-a927d763fdda response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4432025-01-17T08:30:39.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 17cdd340-6688-4f88-9480-9e2a82f01e9e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4442025-01-17T08:30:39.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 17cdd340-6688-4f88-9480-9e2a82f01e9e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4452025-01-17T08:30:39.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 17cdd340-6688-4f88-9480-9e2a82f01e9e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4462025-01-17T08:30:40.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 30d23a81-7947-4fd8-a543-0764ef61bae2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4472025-01-17T08:30:40.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 30d23a81-7947-4fd8-a543-0764ef61bae2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4482025-01-17T08:30:40.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 30d23a81-7947-4fd8-a543-0764ef61bae2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4492025-01-17T08:30:41.881ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
4502025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4512025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4522025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
4532025-01-17T08:30:41.882ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:20:41.881983893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4542025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
4552025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4562025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
4572025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
4582025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
4592025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
4602025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4612025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4622025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
4632025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
4642025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4652025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4662025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
4672025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
4682025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
4692025-01-17T08:30:41.882ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
4702025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
4712025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4722025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4732025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.22\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
4742025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
4752025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
4762025-01-17T08:30:41.882ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4772025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4782025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4792025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4802025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
4812025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
4822025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4832025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
4842025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
4852025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4862025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4872025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
4882025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4892025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4902025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4912025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4922025-01-17T08:30:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4932025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4942025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4952025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
4962025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4972025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4982025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4992025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5002025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5022025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5032025-01-17T08:30:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 59409718 } })
5042025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5052025-01-17T08:30:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 59481288 } })
5062025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5072025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5082025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5092025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.549033ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5102025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5112025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5122025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.644682ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5132025-01-17T08:30:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5142025-01-17T08:30:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5152025-01-17T08:30:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5162025-01-17T08:30:41.885ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:20:41.881983893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5172025-01-17T08:30:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.640369ms iteration = 8 status = {"expiration":"2025-01-17T08:20:41.881983893Z","pruned":[]}
5182025-01-17T08:30:41.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192025-01-17T08:30:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.78951ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5202025-01-17T08:30:41.886ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212025-01-17T08:30:41.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222025-01-17T08:30:41.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
5242025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5252025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5262025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
5272025-01-17T08:30:41.888ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5282025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
5292025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5302025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5312025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
5322025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5332025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5342025-01-17T08:30:41.888ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5352025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5362025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5372025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5382025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5392025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5402025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5412025-01-17T08:30:41.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5422025-01-17T08:30:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5432025-01-17T08:30:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5442025-01-17T08:30:41.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5452025-01-17T08:30:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5462025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5472025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5482025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5492025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
5512025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
5522025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5532025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5542025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
5552025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5562025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
5572025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5582025-01-17T08:30:41.891ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
5592025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5602025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
5612025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5622025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5632025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5642025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5652025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5662025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5672025-01-17T08:30:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5682025-01-17T08:30:41.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 68712621 } })
5692025-01-17T08:30:41.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
5702025-01-17T08:30:41.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 69193445 } })
5712025-01-17T08:30:41.893ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
5722025-01-17T08:30:41.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732025-01-17T08:30:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5742025-01-17T08:30:41.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5752025-01-17T08:30:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5762025-01-17T08:30:41.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772025-01-17T08:30:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5782025-01-17T08:30:41.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5792025-01-17T08:30:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5802025-01-17T08:30:41.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812025-01-17T08:30:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5822025-01-17T08:30:41.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5832025-01-17T08:30:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5842025-01-17T08:30:41.899ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5852025-01-17T08:30:41.899ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5862025-01-17T08:30:41.899ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 16.854633ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5872025-01-17T08:30:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5882025-01-17T08:30:41.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5902025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5912025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5922025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5932025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5942025-01-17T08:30:41.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5952025-01-17T08:30:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5962025-01-17T08:30:41.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5972025-01-17T08:30:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5982025-01-17T08:30:41.905ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.535257ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
5992025-01-17T08:30:41.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.637196ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
6002025-01-17T08:30:41.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6012025-01-17T08:30:41.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 84661398 } })
6022025-01-17T08:30:41.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6032025-01-17T08:30:41.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
6042025-01-17T08:30:41.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052025-01-17T08:30:41.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
6062025-01-17T08:30:41.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6072025-01-17T08:30:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6082025-01-17T08:30:41.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.896183ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6092025-01-17T08:30:41.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6102025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6112025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6122025-01-17T08:30:41.944ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6132025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6142025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6152025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6162025-01-17T08:30:41.944ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6172025-01-17T08:30:41.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc7839a8-903d-40a8-933d-c6a0c440f1bd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6182025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6192025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6202025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212025-01-17T08:30:41.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc7839a8-903d-40a8-933d-c6a0c440f1bd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6222025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6232025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6242025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6252025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6262025-01-17T08:30:41.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6272025-01-17T08:30:41.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6282025-01-17T08:30:41.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6292025-01-17T08:30:41.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6302025-01-17T08:30:41.952ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
6312025-01-17T08:30:41.952ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.568218ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
6322025-01-17T08:30:41.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6332025-01-17T08:30:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6342025-01-17T08:30:41.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352025-01-17T08:30:41.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6362025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6372025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6382025-01-17T08:30:41.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc7839a8-903d-40a8-933d-c6a0c440f1bd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6392025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6402025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6412025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6422025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6432025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6442025-01-17T08:30:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6452025-01-17T08:30:41.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.689776ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6462025-01-17T08:30:41.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6472025-01-17T08:30:41.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6482025-01-17T08:30:41.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6492025-01-17T08:30:41.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6502025-01-17T08:30:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6512025-01-17T08:30:41.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6522025-01-17T08:30:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6532025-01-17T08:30:41.959ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6542025-01-17T08:30:41.959ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6552025-01-17T08:30:41.959ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.264663ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6562025-01-17T08:30:41.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572025-01-17T08:30:41.961ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6582025-01-17T08:30:41.961ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6592025-01-17T08:30:41.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 72.474183ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6602025-01-17T08:30:41.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.647151ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
6612025-01-17T08:30:41.961ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622025-01-17T08:30:41.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6632025-01-17T08:30:41.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6642025-01-17T08:30:41.962ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652025-01-17T08:30:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6662025-01-17T08:30:41.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6672025-01-17T08:30:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6682025-01-17T08:30:41.965ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6692025-01-17T08:30:41.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.618524ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6702025-01-17T08:30:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6712025-01-17T08:30:41.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6722025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6732025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6742025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6752025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6762025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6772025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6782025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6792025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6802025-01-17T08:30:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6812025-01-17T08:30:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
6822025-01-17T08:30:41.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6832025-01-17T08:30:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6842025-01-17T08:30:41.969ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6852025-01-17T08:30:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6862025-01-17T08:30:41.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872025-01-17T08:30:41.971ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882025-01-17T08:30:41.971ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.405717ms iteration = 15 status = 0
6892025-01-17T08:30:41.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902025-01-17T08:30:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6912025-01-17T08:30:41.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6922025-01-17T08:30:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6932025-01-17T08:30:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6942025-01-17T08:30:41.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6952025-01-17T08:30:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6962025-01-17T08:30:41.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6972025-01-17T08:30:41.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6982025-01-17T08:30:41.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6992025-01-17T08:30:41.977ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7002025-01-17T08:30:41.977ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7012025-01-17T08:30:41.978ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
7022025-01-17T08:30:41.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 95.938769ms iteration = 8 status = {"generation":1}
7032025-01-17T08:30:41.978ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.115693ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7042025-01-17T08:30:41.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7052025-01-17T08:30:41.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7062025-01-17T08:30:41.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7072025-01-17T08:30:41.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7082025-01-17T08:30:41.996ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7092025-01-17T08:30:41.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 107.284889ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7102025-01-17T08:30:41.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7112025-01-17T08:30:41.997ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7122025-01-17T08:30:41.997ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
7132025-01-17T08:30:41.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7142025-01-17T08:30:41.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7152025-01-17T08:30:41.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7162025-01-17T08:30:42.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7172025-01-17T08:30:42.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7182025-01-17T08:30:42.002ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
7192025-01-17T08:30:42.002ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.580194ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7202025-01-17T08:30:42.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7212025-01-17T08:30:42.008ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.48629ms iteration = 17 status = {"physical_disks_added":0}
7222025-01-17T08:30:42.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.672633ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7232025-01-17T08:30:42.075ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
7242025-01-17T08:30:42.075ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7252025-01-17T08:30:42.075ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "083e4954-1a7c-474d-8084-aad580660975", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
7262025-01-17T08:30:42.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7272025-01-17T08:30:42.077ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7282025-01-17T08:30:42.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
7292025-01-17T08:30:42.078ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7302025-01-17T08:30:42.079ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e1fd096-7ff9-49dc-9f7b-26e8f16f6ee7", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
7312025-01-17T08:30:42.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7322025-01-17T08:30:42.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7332025-01-17T08:30:42.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7342025-01-17T08:30:42.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7352025-01-17T08:30:42.147ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8f76c2f3-0587-43c1-95e1-2121b1c89afb", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7362025-01-17T08:30:42.147ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7372025-01-17T08:30:42.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "76617071-5fea-4232-a103-845cf71adc7b", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7382025-01-17T08:30:42.149ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7392025-01-17T08:30:42.151ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7402025-01-17T08:30:42.151ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 269.337441ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7412025-01-17T08:30:42.155ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7422025-01-17T08:30:42.155ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7432025-01-17T08:30:42.155ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "72774271-75aa-4511-a4ca-b8ee57553d40", "content-length": "372", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
7442025-01-17T08:30:42.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7452025-01-17T08:30:42.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7462025-01-17T08:30:42.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472025-01-17T08:30:42.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482025-01-17T08:30:42.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7492025-01-17T08:30:42.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7502025-01-17T08:30:42.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7512025-01-17T08:30:42.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7522025-01-17T08:30:42.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7532025-01-17T08:30:42.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7542025-01-17T08:30:42.162ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
7552025-01-17T08:30:42.162ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7562025-01-17T08:30:42.162ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
7572025-01-17T08:30:42.162ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 280.868062ms iteration = 8 status = {"generation":2}
7582025-01-17T08:30:42.169ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
7592025-01-17T08:30:42.169ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7602025-01-17T08:30:42.169ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a04ddd55-4831-43d3-9061-f05131dea6e4", "content-length": "26", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
7612025-01-17T08:30:42.169ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7622025-01-17T08:30:42.171ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
7632025-01-17T08:30:42.200ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7642025-01-17T08:30:42.200ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7652025-01-17T08:30:42.201ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8da711a3-5cf1-48aa-b071-4a51af4139bd", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
7662025-01-17T08:30:42.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7672025-01-17T08:30:42.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7682025-01-17T08:30:42.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692025-01-17T08:30:42.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702025-01-17T08:30:42.209ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
7712025-01-17T08:30:42.209ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 327.664052ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7722025-01-17T08:30:42.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7732025-01-17T08:30:42.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742025-01-17T08:30:42.215ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7752025-01-17T08:30:42.215ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7762025-01-17T08:30:42.216ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bddce088-948a-41af-b1fa-1d972dce02f4", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
7772025-01-17T08:30:42.217ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.834532ms iteration = 15 status = {}
7782025-01-17T08:30:42.219ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7792025-01-17T08:30:42.219ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "142ca09c-5d5b-4439-b730-19d08a7fe240", "content-length": "1", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
7802025-01-17T08:30:42.222ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7812025-01-17T08:30:42.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7822025-01-17T08:30:42.226ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.881921ms iteration = 15 status = null
7832025-01-17T08:30:42.226ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 344.117003ms iteration = 15 status = {}
7842025-01-17T08:30:42.252ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7852025-01-17T08:30:42.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7862025-01-17T08:30:42.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7872025-01-17T08:30:42.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7882025-01-17T08:30:42.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7892025-01-17T08:30:42.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7902025-01-17T08:30:42.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7912025-01-17T08:30:42.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7922025-01-17T08:30:42.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7932025-01-17T08:30:42.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7942025-01-17T08:30:42.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7952025-01-17T08:30:42.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ea29341-950d-405f-afb7-603f7d8a371d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7962025-01-17T08:30:42.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ea29341-950d-405f-afb7-603f7d8a371d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7972025-01-17T08:30:42.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ea29341-950d-405f-afb7-603f7d8a371d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7982025-01-17T08:30:42.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7992025-01-17T08:30:42.323ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e9464bd2-40c1-49cd-86b1-e2fdf1e03f41", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8002025-01-17T08:30:42.323ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8012025-01-17T08:30:42.325ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e030ffb3-2e27-4197-bbda-317129e0855b", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8022025-01-17T08:30:42.325ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8032025-01-17T08:30:42.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "652f0669-032e-40e0-b8c8-7c8f11d4c3dd", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8042025-01-17T08:30:42.326ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8052025-01-17T08:30:42.328ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8062025-01-17T08:30:42.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 446.680394ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8072025-01-17T08:30:42.337ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8082025-01-17T08:30:42.338ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "51960bbb-6bb8-4f06-ae4e-b009c1ee2e91", "content-length": "691", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
8092025-01-17T08:30:42.338ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8102025-01-17T08:30:42.338ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8112025-01-17T08:30:42.338ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8122025-01-17T08:30:42.340ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 458.113005ms iteration = 15 status = {}
8132025-01-17T08:30:42.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8142025-01-17T08:30:42.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8152025-01-17T08:30:42.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
8162025-01-17T08:30:42.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8172025-01-17T08:30:42.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8182025-01-17T08:30:42.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8192025-01-17T08:30:42.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6855bc86-bc38-44b6-a5a3-b6d328a284f9", "content-length": "134", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
8202025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8212025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
8222025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8232025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8242025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8252025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8262025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8272025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8282025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8292025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8302025-01-17T08:30:42.376ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
8312025-01-17T08:30:42.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8322025-01-17T08:30:42.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8332025-01-17T08:30:42.379ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8342025-01-17T08:30:42.379ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f56001f2-9a3b-46e2-ac6e-a88ce5555bc5", "content-length": "2", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
8352025-01-17T08:30:42.379ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8362025-01-17T08:30:42.379ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3215566-b388-4075-bcec-9586345580d0", "content-length": "52", "date": "Fri, 17 Jan 2025 08:30:42 GMT"} })
8372025-01-17T08:30:42.379ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
8382025-01-17T08:30:42.380ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8392025-01-17T08:30:42.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ab118bbf-1be5-490c-802a-7b90871d7fd7", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
8402025-01-17T08:30:42.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
8412025-01-17T08:30:42.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8422025-01-17T08:30:42.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "98ba9b6d-9ff1-403c-9235-57b4139e3699", "content-length": "682", "date": "Fri, 17 Jan 2025 08:30:41 GMT"} })
8432025-01-17T08:30:42.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8442025-01-17T08:30:42.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8452025-01-17T08:30:42.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8462025-01-17T08:30:42.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8472025-01-17T08:30:42.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8482025-01-17T08:30:42.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8492025-01-17T08:30:42.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8502025-01-17T08:30:42.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8512025-01-17T08:30:42.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 609.062289ms iteration = 15 status = {}
8522025-01-17T08:30:42.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd722ad1-b504-4876-be37-545258cda736 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8532025-01-17T08:30:42.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd722ad1-b504-4876-be37-545258cda736 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8542025-01-17T08:30:42.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd722ad1-b504-4876-be37-545258cda736 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8552025-01-17T08:30:43.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 571 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 8c2b76eb-5c4a-4d3c-a2b0-560e8a83d7d2 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
8562025-01-17T08:30:43.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 31516cbf-432f-4569-bd24-65581c02b1c8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8572025-01-17T08:30:43.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 31516cbf-432f-4569-bd24-65581c02b1c8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8582025-01-17T08:30:43.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 31516cbf-432f-4569-bd24-65581c02b1c8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8592025-01-17T08:30:45.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9283e5fe-a239-41b6-8f29-2e9fb67975d8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8602025-01-17T08:30:45.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9283e5fe-a239-41b6-8f29-2e9fb67975d8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8612025-01-17T08:30:45.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2501 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9283e5fe-a239-41b6-8f29-2e9fb67975d8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8622025-01-17T08:30:46.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 71ebc163-756f-41f4-bd52-e4da064fc039 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8632025-01-17T08:30:46.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 71ebc163-756f-41f4-bd52-e4da064fc039 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8642025-01-17T08:30:46.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 71ebc163-756f-41f4-bd52-e4da064fc039 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8652025-01-17T08:30:47.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d5f728e-2522-4874-a38f-4ce13abfe293 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8662025-01-17T08:30:47.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d5f728e-2522-4874-a38f-4ce13abfe293 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8672025-01-17T08:30:47.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2832 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d5f728e-2522-4874-a38f-4ce13abfe293 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8682025-01-17T08:30:48.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 076bb0ad-5152-4325-8ebc-abac342e5f81 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8692025-01-17T08:30:48.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 076bb0ad-5152-4325-8ebc-abac342e5f81 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8702025-01-17T08:30:48.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 076bb0ad-5152-4325-8ebc-abac342e5f81 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8712025-01-17T08:30:49.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8a9df1f-c249-469d-b6ba-62f57e7492a3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8722025-01-17T08:30:49.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8a9df1f-c249-469d-b6ba-62f57e7492a3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8732025-01-17T08:30:49.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e8a9df1f-c249-469d-b6ba-62f57e7492a3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8742025-01-17T08:30:50.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c3820423-69cd-4e57-82e5-427602543adf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8752025-01-17T08:30:50.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c3820423-69cd-4e57-82e5-427602543adf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8762025-01-17T08:30:50.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c3820423-69cd-4e57-82e5-427602543adf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8772025-01-17T08:30:51.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05414b32-c6bc-4faa-a0fe-72892bcfdea5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8782025-01-17T08:30:51.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05414b32-c6bc-4faa-a0fe-72892bcfdea5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8792025-01-17T08:30:51.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05414b32-c6bc-4faa-a0fe-72892bcfdea5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8802025-01-17T08:30:51.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
8812025-01-17T08:30:51.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822025-01-17T08:30:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8832025-01-17T08:30:51.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8842025-01-17T08:30:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8852025-01-17T08:30:51.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8862025-01-17T08:30:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8872025-01-17T08:30:51.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
8882025-01-17T08:30:51.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8892025-01-17T08:30:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8902025-01-17T08:30:51.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912025-01-17T08:30:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8922025-01-17T08:30:51.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8932025-01-17T08:30:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8942025-01-17T08:30:51.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952025-01-17T08:30:51.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.134165ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8962025-01-17T08:30:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
8972025-01-17T08:30:51.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8982025-01-17T08:30:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8992025-01-17T08:30:51.902ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
9002025-01-17T08:30:51.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.958138ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
9012025-01-17T08:30:52.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28433a39-0d57-446c-af32-6114fe415183 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9022025-01-17T08:30:52.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28433a39-0d57-446c-af32-6114fe415183 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9032025-01-17T08:30:52.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28433a39-0d57-446c-af32-6114fe415183 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9042025-01-17T08:30:53.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7398c21-c5b6-4127-a288-dabf6ee61624 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9052025-01-17T08:30:53.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7398c21-c5b6-4127-a288-dabf6ee61624 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9062025-01-17T08:30:53.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7398c21-c5b6-4127-a288-dabf6ee61624 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9072025-01-17T08:30:53.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 34e9d2f8-d7e1-4a89-b189-6fee95892918 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
9082025-01-17T08:30:54.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c64ebe2-4ea4-4e8f-a818-34fe6218ec1f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9092025-01-17T08:30:54.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c64ebe2-4ea4-4e8f-a818-34fe6218ec1f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9102025-01-17T08:30:54.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c64ebe2-4ea4-4e8f-a818-34fe6218ec1f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9112025-01-17T08:30:55.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1206dc4d-1726-4cf0-92ed-4b6dbba6cc2d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9122025-01-17T08:30:55.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1206dc4d-1726-4cf0-92ed-4b6dbba6cc2d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9132025-01-17T08:30:55.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1206dc4d-1726-4cf0-92ed-4b6dbba6cc2d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9142025-01-17T08:30:56.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1e0661b5-ccff-4a12-8164-e69a5896daa2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9152025-01-17T08:30:56.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1e0661b5-ccff-4a12-8164-e69a5896daa2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9162025-01-17T08:30:56.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1e0661b5-ccff-4a12-8164-e69a5896daa2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9172025-01-17T08:30:57.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b854fb2d-7ef5-4089-b0e6-97ffd2e71138 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9182025-01-17T08:30:57.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b854fb2d-7ef5-4089-b0e6-97ffd2e71138 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9192025-01-17T08:30:57.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b854fb2d-7ef5-4089-b0e6-97ffd2e71138 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9202025-01-17T08:30:58.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 406b4740-daaf-46aa-9126-31a108c20ab3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9212025-01-17T08:30:58.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 406b4740-daaf-46aa-9126-31a108c20ab3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9222025-01-17T08:30:58.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 406b4740-daaf-46aa-9126-31a108c20ab3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9232025-01-17T08:30:59.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c215d7f-9a0e-4512-8555-21f6292afaef roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9242025-01-17T08:30:59.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c215d7f-9a0e-4512-8555-21f6292afaef resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9252025-01-17T08:30:59.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2c215d7f-9a0e-4512-8555-21f6292afaef response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9262025-01-17T08:31:00.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd4bb96e-6931-4caa-a9d9-ce03658d879c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9272025-01-17T08:31:00.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd4bb96e-6931-4caa-a9d9-ce03658d879c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9282025-01-17T08:31:00.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd4bb96e-6931-4caa-a9d9-ce03658d879c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9292025-01-17T08:31:01.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f148074e-80a3-43cd-b1b7-656b938a9c2b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9302025-01-17T08:31:01.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f148074e-80a3-43cd-b1b7-656b938a9c2b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9312025-01-17T08:31:01.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f148074e-80a3-43cd-b1b7-656b938a9c2b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9322025-01-17T08:31:01.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
9332025-01-17T08:31:01.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342025-01-17T08:31:01.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9352025-01-17T08:31:01.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362025-01-17T08:31:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9372025-01-17T08:31:01.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382025-01-17T08:31:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392025-01-17T08:31:01.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
9402025-01-17T08:31:01.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9412025-01-17T08:31:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9422025-01-17T08:31:01.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9432025-01-17T08:31:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9442025-01-17T08:31:01.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9452025-01-17T08:31:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9462025-01-17T08:31:01.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9472025-01-17T08:31:01.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.353617ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9482025-01-17T08:31:01.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
9492025-01-17T08:31:01.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502025-01-17T08:31:01.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512025-01-17T08:31:01.902ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
9522025-01-17T08:31:01.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.616615ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
9532025-01-17T08:31:02.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6de42332-db84-4176-9fb2-adcaef59feec roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9542025-01-17T08:31:02.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6de42332-db84-4176-9fb2-adcaef59feec resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9552025-01-17T08:31:02.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6de42332-db84-4176-9fb2-adcaef59feec response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9562025-01-17T08:31:03.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 505bee66-75dc-4d2e-b507-8d72c266a957 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9572025-01-17T08:31:03.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 505bee66-75dc-4d2e-b507-8d72c266a957 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9582025-01-17T08:31:03.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 505bee66-75dc-4d2e-b507-8d72c266a957 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9592025-01-17T08:31:03.494ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 88cbae6e-d53f-4626-bfa1-5fddf2a9443c response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
9602025-01-17T08:31:04.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 64b3fbb6-486b-4a82-859f-2b83a7697dc7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9612025-01-17T08:31:04.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 64b3fbb6-486b-4a82-859f-2b83a7697dc7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9622025-01-17T08:31:04.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 64b3fbb6-486b-4a82-859f-2b83a7697dc7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9632025-01-17T08:31:05.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca541e81-7fae-410e-a8e2-5e69ae939fed roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9642025-01-17T08:31:05.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca541e81-7fae-410e-a8e2-5e69ae939fed resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9652025-01-17T08:31:05.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca541e81-7fae-410e-a8e2-5e69ae939fed response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9662025-01-17T08:31:06.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c431f8c5-05c7-4e7a-b2fb-ee5bcb39d0af roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9672025-01-17T08:31:06.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c431f8c5-05c7-4e7a-b2fb-ee5bcb39d0af resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9682025-01-17T08:31:06.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1705 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c431f8c5-05c7-4e7a-b2fb-ee5bcb39d0af response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9692025-01-17T08:31:07.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d143e258-c984-4bb9-a9ef-d98a4826a277 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9702025-01-17T08:31:07.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d143e258-c984-4bb9-a9ef-d98a4826a277 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9712025-01-17T08:31:07.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d143e258-c984-4bb9-a9ef-d98a4826a277 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9722025-01-17T08:31:08.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f72ed5e-8085-4596-9be4-d4a5d4c0caef roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9732025-01-17T08:31:08.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f72ed5e-8085-4596-9be4-d4a5d4c0caef resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9742025-01-17T08:31:08.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f72ed5e-8085-4596-9be4-d4a5d4c0caef response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9752025-01-17T08:31:09.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e53bf3c-67cd-4448-9409-a13fe3a2d69f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9762025-01-17T08:31:09.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e53bf3c-67cd-4448-9409-a13fe3a2d69f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9772025-01-17T08:31:09.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e53bf3c-67cd-4448-9409-a13fe3a2d69f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9782025-01-17T08:31:10.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 361889cd-92c9-4a05-bb96-6bef71d5d683 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9792025-01-17T08:31:10.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 361889cd-92c9-4a05-bb96-6bef71d5d683 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9802025-01-17T08:31:10.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 361889cd-92c9-4a05-bb96-6bef71d5d683 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9812025-01-17T08:31:11.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e30a0cdb-c02e-45ed-87e7-aefdd778959b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9822025-01-17T08:31:11.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e30a0cdb-c02e-45ed-87e7-aefdd778959b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9832025-01-17T08:31:11.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1837 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e30a0cdb-c02e-45ed-87e7-aefdd778959b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9842025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
9852025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
9862025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9872025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9882025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
9892025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9902025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
9912025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
9922025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9932025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
9942025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9952025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9962025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
9972025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
9982025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9992025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10002025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
10012025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
10022025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10032025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
10042025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10052025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10062025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10072025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10082025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10092025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10102025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10112025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10122025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10132025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10142025-01-17T08:31:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10152025-01-17T08:31:11.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10162025-01-17T08:31:11.886ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.878753ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10172025-01-17T08:31:11.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10182025-01-17T08:31:11.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 62674404 } })
10192025-01-17T08:31:11.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10202025-01-17T08:31:11.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
10212025-01-17T08:31:11.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
10232025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10242025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
10252025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10262025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10272025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
10282025-01-17T08:31:11.888ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10292025-01-17T08:31:11.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10302025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10312025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10322025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10332025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10342025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10352025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10362025-01-17T08:31:11.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10372025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10382025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10392025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10402025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10422025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10432025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10442025-01-17T08:31:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10452025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
10462025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
10472025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10482025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10492025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
10502025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10512025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
10522025-01-17T08:31:11.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10532025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10542025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10552025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10572025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10582025-01-17T08:31:11.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10592025-01-17T08:31:11.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10602025-01-17T08:31:11.893ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 69101815 } })
10612025-01-17T08:31:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10622025-01-17T08:31:11.893ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
10632025-01-17T08:31:11.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10642025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10652025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10662025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10672025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10682025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10692025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10702025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10712025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10722025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10732025-01-17T08:31:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10742025-01-17T08:31:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10752025-01-17T08:31:11.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762025-01-17T08:31:11.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 73314448 } })
10772025-01-17T08:31:11.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10782025-01-17T08:31:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10792025-01-17T08:31:11.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
10802025-01-17T08:31:11.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10812025-01-17T08:31:11.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10822025-01-17T08:31:11.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10832025-01-17T08:31:11.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10842025-01-17T08:31:11.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10852025-01-17T08:31:11.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10862025-01-17T08:31:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10872025-01-17T08:31:11.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.438076ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
10882025-01-17T08:31:11.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.651209ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
10892025-01-17T08:31:11.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10902025-01-17T08:31:11.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10912025-01-17T08:31:11.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922025-01-17T08:31:11.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10932025-01-17T08:31:11.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10942025-01-17T08:31:11.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10952025-01-17T08:31:11.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962025-01-17T08:31:11.909ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10972025-01-17T08:31:11.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.600221ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10982025-01-17T08:31:11.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10992025-01-17T08:31:11.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11002025-01-17T08:31:11.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11012025-01-17T08:31:11.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11022025-01-17T08:31:11.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11032025-01-17T08:31:11.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11042025-01-17T08:31:11.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11052025-01-17T08:31:11.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11062025-01-17T08:31:11.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11072025-01-17T08:31:11.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11082025-01-17T08:31:11.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11092025-01-17T08:31:11.940ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11102025-01-17T08:31:11.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11112025-01-17T08:31:11.941ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11122025-01-17T08:31:11.941ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11132025-01-17T08:31:11.941ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11142025-01-17T08:31:11.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11152025-01-17T08:31:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11162025-01-17T08:31:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11172025-01-17T08:31:11.942ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11182025-01-17T08:31:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11192025-01-17T08:31:11.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.691169ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11202025-01-17T08:31:11.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212025-01-17T08:31:11.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
11222025-01-17T08:31:11.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11232025-01-17T08:31:11.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11242025-01-17T08:31:11.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11252025-01-17T08:31:11.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11262025-01-17T08:31:11.960ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 77.683595ms iteration = 18 status = {"physical_disks_added":0}
11272025-01-17T08:31:11.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
11282025-01-17T08:31:11.971ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11292025-01-17T08:31:11.972ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2ff977-5fb1-4c45-91d8-669a5d9a8ea2", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11302025-01-17T08:31:11.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11312025-01-17T08:31:11.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11322025-01-17T08:31:11.999ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
11332025-01-17T08:31:11.999ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11342025-01-17T08:31:11.999ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57411a98-1a59-479d-b3e5-56648b6f6947", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11352025-01-17T08:31:11.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11362025-01-17T08:31:12.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11372025-01-17T08:31:12.029ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11382025-01-17T08:31:12.029ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11392025-01-17T08:31:12.029ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "486044ae-7a77-49fb-a759-57eb24a58b51", "content-length": "372", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11402025-01-17T08:31:12.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11412025-01-17T08:31:12.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11422025-01-17T08:31:12.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432025-01-17T08:31:12.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442025-01-17T08:31:12.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452025-01-17T08:31:12.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462025-01-17T08:31:12.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11472025-01-17T08:31:12.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11482025-01-17T08:31:12.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11492025-01-17T08:31:12.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11502025-01-17T08:31:12.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11512025-01-17T08:31:12.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11522025-01-17T08:31:12.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11532025-01-17T08:31:12.038ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
11542025-01-17T08:31:12.038ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 155.400209ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11552025-01-17T08:31:12.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
11562025-01-17T08:31:12.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11572025-01-17T08:31:12.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11582025-01-17T08:31:12.043ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 159.848914ms iteration = 16 status = 0
11592025-01-17T08:31:12.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
11602025-01-17T08:31:12.046ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11612025-01-17T08:31:12.046ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd6c0c7-f57c-406d-8469-aa4c80398613", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11622025-01-17T08:31:12.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11632025-01-17T08:31:12.048ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
11642025-01-17T08:31:12.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
11652025-01-17T08:31:12.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 168.829186ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
11662025-01-17T08:31:12.064ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11672025-01-17T08:31:12.064ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11682025-01-17T08:31:12.064ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.441928ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11692025-01-17T08:31:12.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 183.356431ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11702025-01-17T08:31:12.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 174.905994ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11712025-01-17T08:31:12.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 175.243897ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11722025-01-17T08:31:12.087ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11732025-01-17T08:31:12.087ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11742025-01-17T08:31:12.088ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e10724ac-2362-4a9c-8d65-2886d93f1a1c", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11752025-01-17T08:31:12.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11762025-01-17T08:31:12.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11772025-01-17T08:31:12.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11782025-01-17T08:31:12.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11792025-01-17T08:31:12.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11802025-01-17T08:31:12.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11812025-01-17T08:31:12.096ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11822025-01-17T08:31:12.096ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f62dcfac-5c4c-4512-8db6-d4a2e2bc781d", "content-length": "1", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11832025-01-17T08:31:12.097ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11842025-01-17T08:31:12.097ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11852025-01-17T08:31:12.097ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11862025-01-17T08:31:12.097ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3b706f0a-bc18-4dd8-94db-0a506dca0308", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11872025-01-17T08:31:12.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11882025-01-17T08:31:12.098ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 210.009612ms iteration = 16 status = {}
11892025-01-17T08:31:12.098ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.654596ms iteration = 16 status = null
11902025-01-17T08:31:12.100ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.306529ms iteration = 16 status = {}
11912025-01-17T08:31:12.139ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11922025-01-17T08:31:12.139ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc4247f-4452-470e-a10f-0d0c324a1d1b", "content-length": "691", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
11932025-01-17T08:31:12.139ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11942025-01-17T08:31:12.139ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11952025-01-17T08:31:12.139ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11962025-01-17T08:31:12.140ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 257.397997ms iteration = 16 status = {}
11972025-01-17T08:31:12.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11982025-01-17T08:31:12.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11992025-01-17T08:31:12.177ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
12002025-01-17T08:31:12.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12012025-01-17T08:31:12.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12022025-01-17T08:31:12.186ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12032025-01-17T08:31:12.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "43aa7ef8-fe4a-491b-827d-8ed254aa3a2d", "content-length": "134", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
12042025-01-17T08:31:12.186ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12052025-01-17T08:31:12.186ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
12062025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12072025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12082025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12092025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12102025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12112025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12122025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12132025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12142025-01-17T08:31:12.187ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
12152025-01-17T08:31:12.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12162025-01-17T08:31:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12172025-01-17T08:31:12.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12182025-01-17T08:31:12.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "927fe397-8dd6-4a87-a128-263bb7ce34d6", "content-length": "2", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
12192025-01-17T08:31:12.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12202025-01-17T08:31:12.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d94e4ffd-d1a1-4db7-93d0-dbafc724dfd4", "content-length": "52", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
12212025-01-17T08:31:12.190ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
12222025-01-17T08:31:12.190ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12232025-01-17T08:31:12.282ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e42fa05-370a-41cd-8570-3015261006f1", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
12242025-01-17T08:31:12.282ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
12252025-01-17T08:31:12.282ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12262025-01-17T08:31:12.282ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "09bc45e7-220f-4c0e-88d7-c5aab6ae7b56", "content-length": "682", "date": "Fri, 17 Jan 2025 08:31:11 GMT"} })
12272025-01-17T08:31:12.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12282025-01-17T08:31:12.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12292025-01-17T08:31:12.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12302025-01-17T08:31:12.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12312025-01-17T08:31:12.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12322025-01-17T08:31:12.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12332025-01-17T08:31:12.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12342025-01-17T08:31:12.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12352025-01-17T08:31:12.299ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 416.037132ms iteration = 16 status = {}
12362025-01-17T08:31:12.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 9fa67d58-d184-46ed-a45d-7dfdc6e99503 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12372025-01-17T08:31:12.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 9fa67d58-d184-46ed-a45d-7dfdc6e99503 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12382025-01-17T08:31:12.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 9fa67d58-d184-46ed-a45d-7dfdc6e99503 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12392025-01-17T08:31:12.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 39124f28-0ac8-404e-bd20-6bcdd211b782 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12402025-01-17T08:31:12.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 39124f28-0ac8-404e-bd20-6bcdd211b782 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12412025-01-17T08:31:12.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 39124f28-0ac8-404e-bd20-6bcdd211b782 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12422025-01-17T08:31:13.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = f43986ea-b688-47c0-81fd-9156e3555239 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
12432025-01-17T08:31:13.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e594f92-7b0e-4fe8-89a4-a66ad3882ccc roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12442025-01-17T08:31:13.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e594f92-7b0e-4fe8-89a4-a66ad3882ccc resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12452025-01-17T08:31:13.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e594f92-7b0e-4fe8-89a4-a66ad3882ccc response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12462025-01-17T08:31:14.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1250a926-5095-4929-b7eb-4193744870a2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12472025-01-17T08:31:14.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1250a926-5095-4929-b7eb-4193744870a2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12482025-01-17T08:31:14.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1250a926-5095-4929-b7eb-4193744870a2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12492025-01-17T08:31:15.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b551b054-9231-42fc-927d-18f99d8dab03 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12502025-01-17T08:31:15.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b551b054-9231-42fc-927d-18f99d8dab03 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12512025-01-17T08:31:15.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b551b054-9231-42fc-927d-18f99d8dab03 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12522025-01-17T08:31:16.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a63913f7-0050-4a70-ae4f-86fe2793e4fc roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12532025-01-17T08:31:16.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a63913f7-0050-4a70-ae4f-86fe2793e4fc resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12542025-01-17T08:31:16.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a63913f7-0050-4a70-ae4f-86fe2793e4fc response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12552025-01-17T08:31:17.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 052a28a5-a103-402f-a7d8-fdbff55ce7bf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12562025-01-17T08:31:17.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 052a28a5-a103-402f-a7d8-fdbff55ce7bf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12572025-01-17T08:31:17.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 052a28a5-a103-402f-a7d8-fdbff55ce7bf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12582025-01-17T08:31:18.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9d51d978-fb6f-4517-8309-6a197a15d832 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12592025-01-17T08:31:18.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9d51d978-fb6f-4517-8309-6a197a15d832 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12602025-01-17T08:31:18.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9d51d978-fb6f-4517-8309-6a197a15d832 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12612025-01-17T08:31:19.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d1c0577-a344-4b50-bb6d-b8c23484c1c4 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12622025-01-17T08:31:19.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d1c0577-a344-4b50-bb6d-b8c23484c1c4 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12632025-01-17T08:31:19.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d1c0577-a344-4b50-bb6d-b8c23484c1c4 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12642025-01-17T08:31:20.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d8991eb-6940-4ee5-bc8a-e2499f718565 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12652025-01-17T08:31:20.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d8991eb-6940-4ee5-bc8a-e2499f718565 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12662025-01-17T08:31:20.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d8991eb-6940-4ee5-bc8a-e2499f718565 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12672025-01-17T08:31:21.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f8b525c1-1762-402d-9e03-e71fb3b135af roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12682025-01-17T08:31:21.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f8b525c1-1762-402d-9e03-e71fb3b135af resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12692025-01-17T08:31:21.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f8b525c1-1762-402d-9e03-e71fb3b135af response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12702025-01-17T08:31:21.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
12712025-01-17T08:31:21.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12722025-01-17T08:31:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12732025-01-17T08:31:21.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742025-01-17T08:31:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12752025-01-17T08:31:21.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12762025-01-17T08:31:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12772025-01-17T08:31:21.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
12782025-01-17T08:31:21.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12792025-01-17T08:31:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12802025-01-17T08:31:21.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12812025-01-17T08:31:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12822025-01-17T08:31:21.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12832025-01-17T08:31:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12842025-01-17T08:31:21.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852025-01-17T08:31:21.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.270786ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12862025-01-17T08:31:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
12872025-01-17T08:31:21.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12882025-01-17T08:31:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12892025-01-17T08:31:21.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
12902025-01-17T08:31:21.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.151121ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
12912025-01-17T08:31:22.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 894ec191-ef6b-4b96-a9d5-470dcfc2f3ef roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12922025-01-17T08:31:22.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 894ec191-ef6b-4b96-a9d5-470dcfc2f3ef resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12932025-01-17T08:31:22.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 894ec191-ef6b-4b96-a9d5-470dcfc2f3ef response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12942025-01-17T08:31:23.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 552 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 178772e6-f78e-4e21-876b-24ec4d01d2a3 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
12952025-01-17T08:31:23.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6faecb97-125d-4f5d-85d7-ca97e0e58ab1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12962025-01-17T08:31:23.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6faecb97-125d-4f5d-85d7-ca97e0e58ab1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12972025-01-17T08:31:23.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6faecb97-125d-4f5d-85d7-ca97e0e58ab1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12982025-01-17T08:31:24.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 853d58f3-d962-4334-88eb-409377ba5dce roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
12992025-01-17T08:31:24.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 853d58f3-d962-4334-88eb-409377ba5dce resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13002025-01-17T08:31:24.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 853d58f3-d962-4334-88eb-409377ba5dce response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13012025-01-17T08:31:25.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d702f044-32e5-47d0-b9ee-a49324894961 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13022025-01-17T08:31:25.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d702f044-32e5-47d0-b9ee-a49324894961 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13032025-01-17T08:31:25.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d702f044-32e5-47d0-b9ee-a49324894961 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13042025-01-17T08:31:26.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 620b3168-cad6-476f-a317-e9c28f46dfe0 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13052025-01-17T08:31:26.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 620b3168-cad6-476f-a317-e9c28f46dfe0 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13062025-01-17T08:31:26.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 620b3168-cad6-476f-a317-e9c28f46dfe0 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13072025-01-17T08:31:27.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 848f5c21-52f9-43c4-9358-3c1db4af5d8b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13082025-01-17T08:31:27.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 848f5c21-52f9-43c4-9358-3c1db4af5d8b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13092025-01-17T08:31:27.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 848f5c21-52f9-43c4-9358-3c1db4af5d8b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13102025-01-17T08:31:28.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ef107f7-1d6b-462f-975e-b6b2545042b1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13112025-01-17T08:31:28.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ef107f7-1d6b-462f-975e-b6b2545042b1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13122025-01-17T08:31:28.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8ef107f7-1d6b-462f-975e-b6b2545042b1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13132025-01-17T08:31:29.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d6b2957-7b33-45a3-8fa2-489aeab091b5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13142025-01-17T08:31:29.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d6b2957-7b33-45a3-8fa2-489aeab091b5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13152025-01-17T08:31:29.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1678 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d6b2957-7b33-45a3-8fa2-489aeab091b5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13162025-01-17T08:31:30.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 255e3eb8-df42-47b9-ba77-7e7fff9dc384 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13172025-01-17T08:31:30.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 255e3eb8-df42-47b9-ba77-7e7fff9dc384 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13182025-01-17T08:31:30.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 255e3eb8-df42-47b9-ba77-7e7fff9dc384 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13192025-01-17T08:31:31.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
13202025-01-17T08:31:31.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13212025-01-17T08:31:31.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13222025-01-17T08:31:31.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232025-01-17T08:31:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13242025-01-17T08:31:31.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13252025-01-17T08:31:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13262025-01-17T08:31:31.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272025-01-17T08:31:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13282025-01-17T08:31:31.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
13292025-01-17T08:31:31.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13302025-01-17T08:31:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13312025-01-17T08:31:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322025-01-17T08:31:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
13332025-01-17T08:31:31.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13342025-01-17T08:31:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13352025-01-17T08:31:31.908ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
13362025-01-17T08:31:31.908ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.720273ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
13372025-01-17T08:31:31.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13382025-01-17T08:31:31.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13392025-01-17T08:31:31.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.36934ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13402025-01-17T08:31:32.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fc1adffc-d9b8-4a46-a94a-490daef7f2cf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13412025-01-17T08:31:32.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fc1adffc-d9b8-4a46-a94a-490daef7f2cf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13422025-01-17T08:31:32.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fc1adffc-d9b8-4a46-a94a-490daef7f2cf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13432025-01-17T08:31:33.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42a17de4-fc94-4e6d-9803-1f9ff3870796 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13442025-01-17T08:31:33.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42a17de4-fc94-4e6d-9803-1f9ff3870796 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13452025-01-17T08:31:33.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42a17de4-fc94-4e6d-9803-1f9ff3870796 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13462025-01-17T08:31:33.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 564 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 4ba46e4d-cc18-4281-9c1b-a5656a9227c6 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
13472025-01-17T08:31:34.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3e7e5a16-fffc-4d19-8beb-762d1e0465e6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13482025-01-17T08:31:34.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3e7e5a16-fffc-4d19-8beb-762d1e0465e6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13492025-01-17T08:31:34.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3e7e5a16-fffc-4d19-8beb-762d1e0465e6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13502025-01-17T08:31:35.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ff63930-d8e5-4e80-a79c-4239ee2decba roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13512025-01-17T08:31:35.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ff63930-d8e5-4e80-a79c-4239ee2decba resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13522025-01-17T08:31:35.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ff63930-d8e5-4e80-a79c-4239ee2decba response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13532025-01-17T08:31:36.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ebcdcebd-a504-4b6c-8ffc-7e11e38fc44f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13542025-01-17T08:31:36.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ebcdcebd-a504-4b6c-8ffc-7e11e38fc44f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13552025-01-17T08:31:36.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ebcdcebd-a504-4b6c-8ffc-7e11e38fc44f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13562025-01-17T08:31:37.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20a117e3-655b-4211-9254-54fb538c9f94 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13572025-01-17T08:31:37.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20a117e3-655b-4211-9254-54fb538c9f94 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13582025-01-17T08:31:37.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20a117e3-655b-4211-9254-54fb538c9f94 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13592025-01-17T08:31:38.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a9f4e63-0894-45f4-a880-7ddf2a544622 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13602025-01-17T08:31:38.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a9f4e63-0894-45f4-a880-7ddf2a544622 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13612025-01-17T08:31:38.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a9f4e63-0894-45f4-a880-7ddf2a544622 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13622025-01-17T08:31:39.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae23fb68-4293-42ce-8031-09823afd8fe5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13632025-01-17T08:31:39.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae23fb68-4293-42ce-8031-09823afd8fe5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13642025-01-17T08:31:39.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae23fb68-4293-42ce-8031-09823afd8fe5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13652025-01-17T08:31:40.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ce682cd8-7e41-46e5-b91d-bce171390d26 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13662025-01-17T08:31:40.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ce682cd8-7e41-46e5-b91d-bce171390d26 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13672025-01-17T08:31:40.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ce682cd8-7e41-46e5-b91d-bce171390d26 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13682025-01-17T08:31:41.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8debd388-e65e-4bdd-a071-bbec9f302c60 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13692025-01-17T08:31:41.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8debd388-e65e-4bdd-a071-bbec9f302c60 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13702025-01-17T08:31:41.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8debd388-e65e-4bdd-a071-bbec9f302c60 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
13712025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
13722025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
13732025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13742025-01-17T08:31:41.882ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:21:41.882097109 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13752025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13762025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13772025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
13782025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
13792025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13802025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13812025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
13822025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
13832025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
13842025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13852025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13862025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13872025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
13882025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
13892025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13902025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
13912025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13922025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13932025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
13942025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13952025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
13962025-01-17T08:31:41.882ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
13972025-01-17T08:31:41.883ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
13982025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13992025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
14002025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 30.971\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
14012025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
14022025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14032025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14042025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
14052025-01-17T08:31:41.883ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14062025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
14072025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14082025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
14092025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
14102025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14112025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
14122025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14132025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14142025-01-17T08:31:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 58854894 } })
14152025-01-17T08:31:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 58876263 } })
14162025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14172025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14182025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14192025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14202025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14212025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14222025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14232025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14242025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14252025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14262025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14272025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14282025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
14292025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14302025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14312025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14322025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.533462ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14332025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14342025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.642453ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14352025-01-17T08:31:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14362025-01-17T08:31:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14372025-01-17T08:31:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14382025-01-17T08:31:41.885ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:21:41.882097109 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14392025-01-17T08:31:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.921783ms iteration = 9 status = {"expiration":"2025-01-17T08:21:41.882097109Z","pruned":[]}
14402025-01-17T08:31:41.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-01-17T08:31:41.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 62467872 } })
14422025-01-17T08:31:41.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432025-01-17T08:31:41.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
14442025-01-17T08:31:41.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452025-01-17T08:31:41.887ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.737008ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14462025-01-17T08:31:41.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 63425370 } })
14472025-01-17T08:31:41.888ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
14482025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14492025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14502025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14512025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
14522025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14532025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14542025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
14552025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
14562025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14572025-01-17T08:31:41.889ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14582025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
14592025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14602025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14612025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14622025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14632025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14642025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14652025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14662025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14672025-01-17T08:31:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14682025-01-17T08:31:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14692025-01-17T08:31:41.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14702025-01-17T08:31:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14712025-01-17T08:31:41.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14722025-01-17T08:31:41.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
14742025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
14752025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14762025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14772025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
14782025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14792025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
14802025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14812025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
14822025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14832025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
14842025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14852025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14862025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14872025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14882025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14892025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14902025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14912025-01-17T08:31:41.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922025-01-17T08:31:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14932025-01-17T08:31:41.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14962025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14972025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14982025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14992025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15002025-01-17T08:31:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15012025-01-17T08:31:41.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15022025-01-17T08:31:41.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15032025-01-17T08:31:41.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15042025-01-17T08:31:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15052025-01-17T08:31:41.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15062025-01-17T08:31:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15072025-01-17T08:31:41.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15082025-01-17T08:31:41.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 80747597 } })
15092025-01-17T08:31:41.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
15102025-01-17T08:31:41.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15112025-01-17T08:31:41.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15122025-01-17T08:31:41.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15132025-01-17T08:31:41.910ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.927412ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
15142025-01-17T08:31:41.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15152025-01-17T08:31:41.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15162025-01-17T08:31:41.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15172025-01-17T08:31:41.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182025-01-17T08:31:41.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15192025-01-17T08:31:41.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15202025-01-17T08:31:41.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15212025-01-17T08:31:41.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15222025-01-17T08:31:41.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15232025-01-17T08:31:41.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15242025-01-17T08:31:41.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252025-01-17T08:31:41.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15262025-01-17T08:31:41.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15272025-01-17T08:31:41.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15282025-01-17T08:31:41.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15292025-01-17T08:31:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
15302025-01-17T08:31:41.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15312025-01-17T08:31:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15322025-01-17T08:31:41.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332025-01-17T08:31:41.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342025-01-17T08:31:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15352025-01-17T08:31:41.935ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15362025-01-17T08:31:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15372025-01-17T08:31:41.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15382025-01-17T08:31:41.939ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15392025-01-17T08:31:41.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15402025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15412025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15422025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15432025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15442025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15452025-01-17T08:31:41.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15462025-01-17T08:31:41.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15472025-01-17T08:31:41.943ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15482025-01-17T08:31:41.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15492025-01-17T08:31:41.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15502025-01-17T08:31:41.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15512025-01-17T08:31:41.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.672157ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
15522025-01-17T08:31:41.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532025-01-17T08:31:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15542025-01-17T08:31:41.950ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15552025-01-17T08:31:41.950ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15562025-01-17T08:31:41.950ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15572025-01-17T08:31:41.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.668004ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
15582025-01-17T08:31:41.951ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15592025-01-17T08:31:41.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15602025-01-17T08:31:41.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15612025-01-17T08:31:41.953ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15622025-01-17T08:31:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15632025-01-17T08:31:41.961ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15642025-01-17T08:31:41.961ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15652025-01-17T08:31:41.961ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.089947ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15662025-01-17T08:31:41.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15672025-01-17T08:31:41.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15682025-01-17T08:31:41.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15692025-01-17T08:31:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15702025-01-17T08:31:41.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15712025-01-17T08:31:41.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15722025-01-17T08:31:41.982ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15732025-01-17T08:31:41.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.495449ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15742025-01-17T08:31:41.984ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15752025-01-17T08:31:41.984ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15762025-01-17T08:31:41.984ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15772025-01-17T08:31:41.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15782025-01-17T08:31:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15792025-01-17T08:31:41.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15802025-01-17T08:31:41.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15812025-01-17T08:31:42.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15822025-01-17T08:31:42.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15832025-01-17T08:31:42.044ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15842025-01-17T08:31:42.154ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15852025-01-17T08:31:42.154ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15862025-01-17T08:31:42.154ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72a1784-6e91-4d66-b4fb-19d7070bddde", "content-length": "372", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
15872025-01-17T08:31:42.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15882025-01-17T08:31:42.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15892025-01-17T08:31:42.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15902025-01-17T08:31:42.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15912025-01-17T08:31:42.166ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15922025-01-17T08:31:42.166ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15932025-01-17T08:31:42.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15942025-01-17T08:31:42.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15952025-01-17T08:31:42.170ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
15962025-01-17T08:31:42.170ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 287.497675ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
15972025-01-17T08:31:42.193ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15982025-01-17T08:31:42.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 304.782922ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15992025-01-17T08:31:42.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16002025-01-17T08:31:42.199ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012025-01-17T08:31:42.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16022025-01-17T08:31:42.200ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032025-01-17T08:31:42.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16042025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 321.00352ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16052025-01-17T08:31:42.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
16062025-01-17T08:31:42.204ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16072025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
16082025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16092025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16102025-01-17T08:31:42.204ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16112025-01-17T08:31:42.204ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16122025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 315.200604ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16132025-01-17T08:31:42.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94ecec5f-6c30-425f-9a5e-281b3816e104", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} })
16142025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16152025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16162025-01-17T08:31:42.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16172025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16182025-01-17T08:31:42.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16192025-01-17T08:31:42.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e6721414-60bd-4048-9ae2-cb8d72bcd711", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16202025-01-17T08:31:42.205ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16212025-01-17T08:31:42.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16222025-01-17T08:31:42.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16232025-01-17T08:31:42.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
16242025-01-17T08:31:42.205ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16252025-01-17T08:31:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16262025-01-17T08:31:42.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16272025-01-17T08:31:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16282025-01-17T08:31:42.206ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b27d7d21-530b-4258-9239-69a7db0f53ae", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} })
16292025-01-17T08:31:42.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16302025-01-17T08:31:42.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16312025-01-17T08:31:42.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16322025-01-17T08:31:42.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 320.024972ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16332025-01-17T08:31:42.212ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 329.640809ms iteration = 17 status = 0
16342025-01-17T08:31:42.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16352025-01-17T08:31:42.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16362025-01-17T08:31:42.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16372025-01-17T08:31:42.214ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16382025-01-17T08:31:42.214ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16392025-01-17T08:31:42.214ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 331.192151ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16402025-01-17T08:31:42.215ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16412025-01-17T08:31:42.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
16422025-01-17T08:31:42.215ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16432025-01-17T08:31:42.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16442025-01-17T08:31:42.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e809a9f2-3092-43f6-a7cd-ce44b9430bc1", "content-length": "26", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} })
16452025-01-17T08:31:42.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16462025-01-17T08:31:42.217ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f7732c2b-f229-4d77-a2f9-da77314157be", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16472025-01-17T08:31:42.217ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16482025-01-17T08:31:42.219ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16492025-01-17T08:31:42.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
16502025-01-17T08:31:42.222ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
16512025-01-17T08:31:42.222ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 340.764156ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16522025-01-17T08:31:42.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd5e3d9b-d015-4e19-bcaa-a93be697316e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
16532025-01-17T08:31:42.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd5e3d9b-d015-4e19-bcaa-a93be697316e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
16542025-01-17T08:31:42.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cd5e3d9b-d015-4e19-bcaa-a93be697316e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
16552025-01-17T08:31:42.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16562025-01-17T08:31:42.231ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16572025-01-17T08:31:42.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 345.883997ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
16582025-01-17T08:31:42.239ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b188a9c-b70a-4965-88fe-7525f5d026ac", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
16592025-01-17T08:31:42.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16602025-01-17T08:31:42.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16612025-01-17T08:31:42.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16622025-01-17T08:31:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16632025-01-17T08:31:42.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16642025-01-17T08:31:42.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16652025-01-17T08:31:42.246ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
16662025-01-17T08:31:42.246ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 363.172243ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
16672025-01-17T08:31:42.248ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16682025-01-17T08:31:42.248ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16692025-01-17T08:31:42.248ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "395fb604-667f-4452-b3c9-3bb01c3d5232", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
16702025-01-17T08:31:42.250ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.889766ms iteration = 17 status = {}
16712025-01-17T08:31:42.250ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16722025-01-17T08:31:42.250ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
16732025-01-17T08:31:42.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16742025-01-17T08:31:42.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16752025-01-17T08:31:42.256ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
16762025-01-17T08:31:42.256ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 373.247153ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16772025-01-17T08:31:42.257ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16782025-01-17T08:31:42.257ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16792025-01-17T08:31:42.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16802025-01-17T08:31:42.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16812025-01-17T08:31:42.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16822025-01-17T08:31:42.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16832025-01-17T08:31:42.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16842025-01-17T08:31:42.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16852025-01-17T08:31:42.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16862025-01-17T08:31:42.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16872025-01-17T08:31:42.277ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16882025-01-17T08:31:42.277ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 388.324413ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16892025-01-17T08:31:42.278ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 395.002785ms iteration = 19 status = {"physical_disks_added":0}
16902025-01-17T08:31:42.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912025-01-17T08:31:42.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16922025-01-17T08:31:42.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16932025-01-17T08:31:42.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16942025-01-17T08:31:42.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952025-01-17T08:31:42.289ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
16962025-01-17T08:31:42.289ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16972025-01-17T08:31:42.289ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
16982025-01-17T08:31:42.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 407.894027ms iteration = 9 status = {"generation":2}
16992025-01-17T08:31:42.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17002025-01-17T08:31:42.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17012025-01-17T08:31:42.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17022025-01-17T08:31:42.295ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17032025-01-17T08:31:42.295ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17042025-01-17T08:31:42.295ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
17052025-01-17T08:31:42.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 413.25884ms iteration = 9 status = {"generation":1}
17062025-01-17T08:31:42.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072025-01-17T08:31:42.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17082025-01-17T08:31:42.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17092025-01-17T08:31:42.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17102025-01-17T08:31:42.313ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17112025-01-17T08:31:42.313ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5d5b91d-89f0-4a45-a45c-7b8662e216c7", "content-length": "1", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17122025-01-17T08:31:42.315ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17132025-01-17T08:31:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17142025-01-17T08:31:42.318ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 435.085762ms iteration = 17 status = null
17152025-01-17T08:31:42.318ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17162025-01-17T08:31:42.319ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 436.241491ms iteration = 17 status = {}
17172025-01-17T08:31:42.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17182025-01-17T08:31:42.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b0a3858-eab1-48f9-a321-343601c680c1", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17192025-01-17T08:31:42.356ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17202025-01-17T08:31:42.358ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "14bb802b-8f49-4045-9e63-35aacf101134", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17212025-01-17T08:31:42.358ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17222025-01-17T08:31:42.360ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0a2be2c1-dada-4a89-912d-9229a52bf462", "date": "Fri, 17 Jan 2025 08:31:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17232025-01-17T08:31:42.360ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17242025-01-17T08:31:42.362ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
17252025-01-17T08:31:42.362ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 479.924847ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17262025-01-17T08:31:42.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 87272e77-2b2a-47e9-96c8-793941b6a49d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17272025-01-17T08:31:42.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 87272e77-2b2a-47e9-96c8-793941b6a49d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17282025-01-17T08:31:42.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3239 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 87272e77-2b2a-47e9-96c8-793941b6a49d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17292025-01-17T08:31:42.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17302025-01-17T08:31:42.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17312025-01-17T08:31:42.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
17322025-01-17T08:31:42.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17332025-01-17T08:31:42.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17342025-01-17T08:31:42.412ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17352025-01-17T08:31:42.412ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf304196-bf52-4413-af26-beff7f0ead58", "content-length": "691", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17362025-01-17T08:31:42.412ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17372025-01-17T08:31:42.412ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17382025-01-17T08:31:42.412ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17392025-01-17T08:31:42.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.12045ms iteration = 17 status = {}
17402025-01-17T08:31:42.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17412025-01-17T08:31:42.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bac232c-a0e0-45e8-ba72-69589d70d1ce", "content-length": "134", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17422025-01-17T08:31:42.415ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17432025-01-17T08:31:42.415ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
17442025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17452025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17462025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17472025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17482025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17492025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17502025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17512025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17522025-01-17T08:31:42.416ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
17532025-01-17T08:31:42.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17542025-01-17T08:31:42.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17552025-01-17T08:31:42.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17562025-01-17T08:31:42.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1806e827-91f8-4eba-8cf3-e0ca48624310", "content-length": "2", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17572025-01-17T08:31:42.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17582025-01-17T08:31:42.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a9ef4bb-17df-4b00-9380-0f7d011776d8", "content-length": "52", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17592025-01-17T08:31:42.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
17602025-01-17T08:31:42.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17612025-01-17T08:31:42.506ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9e1d5c3c-de47-4ef1-9b35-7ee29a16ea1e", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17622025-01-17T08:31:42.506ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
17632025-01-17T08:31:42.506ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17642025-01-17T08:31:42.506ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcdbb8d4-5d59-4c17-a615-23ff7d956886", "content-length": "682", "date": "Fri, 17 Jan 2025 08:31:41 GMT"} })
17652025-01-17T08:31:42.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17662025-01-17T08:31:42.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17672025-01-17T08:31:42.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17682025-01-17T08:31:42.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17692025-01-17T08:31:42.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17702025-01-17T08:31:42.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17712025-01-17T08:31:42.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17722025-01-17T08:31:42.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17732025-01-17T08:31:42.522ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 639.939324ms iteration = 17 status = {}
17742025-01-17T08:31:43.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0e09e2c4-5e37-4ebf-a509-72ae9dc26eae roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17752025-01-17T08:31:43.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0e09e2c4-5e37-4ebf-a509-72ae9dc26eae resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17762025-01-17T08:31:43.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0e09e2c4-5e37-4ebf-a509-72ae9dc26eae response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17772025-01-17T08:31:43.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 571 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 10059bba-d268-4c97-aa78-cb6c257112a5 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
17782025-01-17T08:31:44.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de2469a3-05cd-421f-b65f-3da98fdc3313 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17792025-01-17T08:31:44.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de2469a3-05cd-421f-b65f-3da98fdc3313 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17802025-01-17T08:31:44.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de2469a3-05cd-421f-b65f-3da98fdc3313 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17812025-01-17T08:31:45.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 18e22042-27d2-49de-90f9-72802bc64214 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17822025-01-17T08:31:45.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 18e22042-27d2-49de-90f9-72802bc64214 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17832025-01-17T08:31:45.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 18e22042-27d2-49de-90f9-72802bc64214 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17842025-01-17T08:31:46.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a8e534-3ca5-449e-a74a-cc69cccce7ee roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17852025-01-17T08:31:46.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a8e534-3ca5-449e-a74a-cc69cccce7ee resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17862025-01-17T08:31:46.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a8e534-3ca5-449e-a74a-cc69cccce7ee response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17872025-01-17T08:31:47.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6c3054f2-1a2e-44d8-a641-e0f5f7c08efe roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17882025-01-17T08:31:47.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6c3054f2-1a2e-44d8-a641-e0f5f7c08efe resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17892025-01-17T08:31:47.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6c3054f2-1a2e-44d8-a641-e0f5f7c08efe response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17902025-01-17T08:31:48.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b94cab28-2bd0-4fc2-b172-2f9b82393079 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17912025-01-17T08:31:48.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b94cab28-2bd0-4fc2-b172-2f9b82393079 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17922025-01-17T08:31:48.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b94cab28-2bd0-4fc2-b172-2f9b82393079 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17932025-01-17T08:31:49.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8fd939fc-538c-4af2-8f6c-c6e5bed24556 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17942025-01-17T08:31:49.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8fd939fc-538c-4af2-8f6c-c6e5bed24556 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17952025-01-17T08:31:49.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8fd939fc-538c-4af2-8f6c-c6e5bed24556 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17962025-01-17T08:31:50.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 890d6696-3ee1-47d3-8847-e197e6d2ed65 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17972025-01-17T08:31:50.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 890d6696-3ee1-47d3-8847-e197e6d2ed65 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17982025-01-17T08:31:50.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 890d6696-3ee1-47d3-8847-e197e6d2ed65 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
17992025-01-17T08:31:51.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5324040-5ac1-4b69-8ee7-df83ec50f9ea roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18002025-01-17T08:31:51.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5324040-5ac1-4b69-8ee7-df83ec50f9ea resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18012025-01-17T08:31:51.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5324040-5ac1-4b69-8ee7-df83ec50f9ea response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18022025-01-17T08:31:51.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
18032025-01-17T08:31:51.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18042025-01-17T08:31:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18052025-01-17T08:31:51.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062025-01-17T08:31:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18072025-01-17T08:31:51.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18082025-01-17T08:31:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18092025-01-17T08:31:51.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
18102025-01-17T08:31:51.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18112025-01-17T08:31:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18122025-01-17T08:31:51.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18132025-01-17T08:31:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18142025-01-17T08:31:51.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18152025-01-17T08:31:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18162025-01-17T08:31:51.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172025-01-17T08:31:51.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.961131ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18182025-01-17T08:31:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
18192025-01-17T08:31:51.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18202025-01-17T08:31:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18212025-01-17T08:31:51.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
18222025-01-17T08:31:51.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.305146ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
18232025-01-17T08:31:52.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 432d3825-1c35-4fae-9a27-3ec80f320fa5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18242025-01-17T08:31:52.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 432d3825-1c35-4fae-9a27-3ec80f320fa5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18252025-01-17T08:31:52.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 432d3825-1c35-4fae-9a27-3ec80f320fa5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18262025-01-17T08:31:53.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = e1c02821-64de-4085-b28a-a44cf2628d2d response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
18272025-01-17T08:31:53.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abc2dd6f-4e13-4ea6-af7d-e1f88efaa090 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18282025-01-17T08:31:53.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abc2dd6f-4e13-4ea6-af7d-e1f88efaa090 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18292025-01-17T08:31:53.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abc2dd6f-4e13-4ea6-af7d-e1f88efaa090 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18302025-01-17T08:31:54.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffb9c0f1-f267-4dad-b940-ecb3723b9703 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18312025-01-17T08:31:54.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffb9c0f1-f267-4dad-b940-ecb3723b9703 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18322025-01-17T08:31:54.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffb9c0f1-f267-4dad-b940-ecb3723b9703 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18332025-01-17T08:31:55.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b94a777-9576-43c0-8a3d-0e766c7e0ed8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18342025-01-17T08:31:55.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b94a777-9576-43c0-8a3d-0e766c7e0ed8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18352025-01-17T08:31:55.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b94a777-9576-43c0-8a3d-0e766c7e0ed8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18362025-01-17T08:31:56.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 14a8d5e2-2437-4095-bf2c-f9812406820d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18372025-01-17T08:31:56.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 14a8d5e2-2437-4095-bf2c-f9812406820d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18382025-01-17T08:31:56.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 14a8d5e2-2437-4095-bf2c-f9812406820d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18392025-01-17T08:31:57.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1bbfbf7c-7613-4795-87c4-5dae71dfa436 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18402025-01-17T08:31:57.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1bbfbf7c-7613-4795-87c4-5dae71dfa436 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18412025-01-17T08:31:57.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1bbfbf7c-7613-4795-87c4-5dae71dfa436 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18422025-01-17T08:31:58.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6eea1c84-c32d-459b-889d-998097480648 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18432025-01-17T08:31:58.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6eea1c84-c32d-459b-889d-998097480648 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18442025-01-17T08:31:58.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6eea1c84-c32d-459b-889d-998097480648 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18452025-01-17T08:31:59.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae923c81-9d43-47f6-b7ef-e2b24cc6d5e9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18462025-01-17T08:31:59.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae923c81-9d43-47f6-b7ef-e2b24cc6d5e9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18472025-01-17T08:31:59.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae923c81-9d43-47f6-b7ef-e2b24cc6d5e9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18482025-01-17T08:32:00.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7ff5b2fb-1cec-4e69-b4af-41a3c5926819 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18492025-01-17T08:32:00.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7ff5b2fb-1cec-4e69-b4af-41a3c5926819 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18502025-01-17T08:32:00.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7ff5b2fb-1cec-4e69-b4af-41a3c5926819 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18512025-01-17T08:32:01.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b5abfa97-7923-461d-88bd-a085ea8ee19e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18522025-01-17T08:32:01.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b5abfa97-7923-461d-88bd-a085ea8ee19e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18532025-01-17T08:32:01.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b5abfa97-7923-461d-88bd-a085ea8ee19e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18542025-01-17T08:32:01.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
18552025-01-17T08:32:01.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18562025-01-17T08:32:01.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572025-01-17T08:32:01.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582025-01-17T08:32:01.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18592025-01-17T08:32:01.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18602025-01-17T08:32:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18612025-01-17T08:32:01.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
18622025-01-17T08:32:01.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18632025-01-17T08:32:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18642025-01-17T08:32:01.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18652025-01-17T08:32:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18662025-01-17T08:32:01.916ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18672025-01-17T08:32:01.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18682025-01-17T08:32:01.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692025-01-17T08:32:01.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
18702025-01-17T08:32:01.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18712025-01-17T08:32:01.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18722025-01-17T08:32:01.931ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
18732025-01-17T08:32:01.931ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.98709ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
18742025-01-17T08:32:01.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.409874ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18752025-01-17T08:32:02.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2aa9ad29-1677-4d1e-80dd-fed666980d4a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18762025-01-17T08:32:02.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2aa9ad29-1677-4d1e-80dd-fed666980d4a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18772025-01-17T08:32:02.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2aa9ad29-1677-4d1e-80dd-fed666980d4a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18782025-01-17T08:32:03.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = fd709576-826e-44e8-baf2-090f7df7a589 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
18792025-01-17T08:32:03.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b98ac3ba-089e-43ad-9063-7326ef29ab63 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18802025-01-17T08:32:03.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b98ac3ba-089e-43ad-9063-7326ef29ab63 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18812025-01-17T08:32:03.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b98ac3ba-089e-43ad-9063-7326ef29ab63 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18822025-01-17T08:32:04.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6fa06f5-aac8-4b4a-ab15-c4898e9652c1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18832025-01-17T08:32:04.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6fa06f5-aac8-4b4a-ab15-c4898e9652c1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18842025-01-17T08:32:04.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6fa06f5-aac8-4b4a-ab15-c4898e9652c1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18852025-01-17T08:32:05.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f9ced26-61ef-4874-9e7e-3a469d8c4e11 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18862025-01-17T08:32:05.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f9ced26-61ef-4874-9e7e-3a469d8c4e11 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18872025-01-17T08:32:05.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f9ced26-61ef-4874-9e7e-3a469d8c4e11 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18882025-01-17T08:32:06.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbdd62ea-3f65-4f34-820b-2dd95251c6d3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18892025-01-17T08:32:06.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbdd62ea-3f65-4f34-820b-2dd95251c6d3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18902025-01-17T08:32:06.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbdd62ea-3f65-4f34-820b-2dd95251c6d3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18912025-01-17T08:32:07.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 947934fc-918e-46f1-b0cc-64e89bedf961 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18922025-01-17T08:32:07.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 947934fc-918e-46f1-b0cc-64e89bedf961 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18932025-01-17T08:32:07.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 947934fc-918e-46f1-b0cc-64e89bedf961 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18942025-01-17T08:32:08.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a7be8ec6-377b-4f4f-af05-1de71ea8be4c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18952025-01-17T08:32:08.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a7be8ec6-377b-4f4f-af05-1de71ea8be4c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18962025-01-17T08:32:08.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a7be8ec6-377b-4f4f-af05-1de71ea8be4c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18972025-01-17T08:32:09.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c001c085-fea4-4499-a3cc-89e523b8b721 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18982025-01-17T08:32:09.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c001c085-fea4-4499-a3cc-89e523b8b721 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18992025-01-17T08:32:09.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c001c085-fea4-4499-a3cc-89e523b8b721 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19002025-01-17T08:32:10.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1b1f98f8-9281-49e9-94bb-d5aaedb4e8b7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19012025-01-17T08:32:10.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1b1f98f8-9281-49e9-94bb-d5aaedb4e8b7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19022025-01-17T08:32:10.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1b1f98f8-9281-49e9-94bb-d5aaedb4e8b7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19032025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
19042025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
19052025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19062025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19072025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
19082025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19092025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
19102025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
19112025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19122025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
19132025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19142025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
19152025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19162025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
19172025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19182025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
19192025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
19202025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19212025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19222025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19232025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19242025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19252025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19262025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19272025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19282025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19292025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19302025-01-17T08:32:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19312025-01-17T08:32:11.884ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
19322025-01-17T08:32:11.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19332025-01-17T08:32:11.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19342025-01-17T08:32:11.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352025-01-17T08:32:11.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-01-17T08:32:11.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372025-01-17T08:32:11.886ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.64666ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19382025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19392025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19402025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19412025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19422025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19432025-01-17T08:32:11.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19442025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19452025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19462025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19472025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
19482025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
19492025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19502025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
19512025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19522025-01-17T08:32:11.889ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19532025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19542025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19552025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19562025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19572025-01-17T08:32:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19582025-01-17T08:32:11.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 66598215 } })
19592025-01-17T08:32:11.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602025-01-17T08:32:11.891ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
19612025-01-17T08:32:11.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 67059238 } })
19622025-01-17T08:32:11.891ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
19632025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19642025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
19652025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
19662025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19672025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19682025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
19692025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19702025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
19712025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19722025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19732025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19742025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19752025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19762025-01-17T08:32:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19772025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19782025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19792025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19802025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19812025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19822025-01-17T08:32:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19832025-01-17T08:32:11.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19842025-01-17T08:32:11.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19852025-01-17T08:32:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19862025-01-17T08:32:11.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19872025-01-17T08:32:11.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.38819ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
19882025-01-17T08:32:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
19892025-01-17T08:32:11.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19902025-01-17T08:32:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19912025-01-17T08:32:11.906ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19922025-01-17T08:32:11.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.761342ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19932025-01-17T08:32:11.911ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
19942025-01-17T08:32:11.911ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.809678ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
19952025-01-17T08:32:11.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19962025-01-17T08:32:11.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19972025-01-17T08:32:11.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca3737fa-8602-425c-8758-95d2371f8b69 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19982025-01-17T08:32:11.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca3737fa-8602-425c-8758-95d2371f8b69 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19992025-01-17T08:32:11.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20002025-01-17T08:32:11.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20012025-01-17T08:32:11.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1797 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca3737fa-8602-425c-8758-95d2371f8b69 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
20022025-01-17T08:32:11.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20032025-01-17T08:32:11.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20042025-01-17T08:32:11.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20052025-01-17T08:32:11.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20062025-01-17T08:32:11.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072025-01-17T08:32:11.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20082025-01-17T08:32:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20092025-01-17T08:32:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20102025-01-17T08:32:11.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20112025-01-17T08:32:11.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20122025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20132025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20142025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20152025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20162025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172025-01-17T08:32:11.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 43.674126ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20182025-01-17T08:32:11.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20192025-01-17T08:32:11.936ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 112118935 } })
20202025-01-17T08:32:11.937ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
20212025-01-17T08:32:11.937ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20222025-01-17T08:32:11.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20232025-01-17T08:32:11.938ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20242025-01-17T08:32:11.938ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20252025-01-17T08:32:11.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20262025-01-17T08:32:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20272025-01-17T08:32:11.938ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20282025-01-17T08:32:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20292025-01-17T08:32:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20302025-01-17T08:32:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
20312025-01-17T08:32:11.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20322025-01-17T08:32:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20332025-01-17T08:32:11.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20342025-01-17T08:32:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20352025-01-17T08:32:11.942ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.050807ms iteration = 18 status = 0
20362025-01-17T08:32:11.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20372025-01-17T08:32:11.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20382025-01-17T08:32:11.943ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.364597ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
20392025-01-17T08:32:11.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20402025-01-17T08:32:11.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20412025-01-17T08:32:11.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20422025-01-17T08:32:11.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20432025-01-17T08:32:11.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20442025-01-17T08:32:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20452025-01-17T08:32:11.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20462025-01-17T08:32:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20472025-01-17T08:32:11.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
20482025-01-17T08:32:11.957ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20492025-01-17T08:32:11.957ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8368c244-676d-47fd-ba7b-f5c55c6b7eb8", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
20502025-01-17T08:32:11.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20512025-01-17T08:32:11.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20522025-01-17T08:32:11.966ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20532025-01-17T08:32:11.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20542025-01-17T08:32:11.968ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20552025-01-17T08:32:11.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20562025-01-17T08:32:11.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.212245ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20572025-01-17T08:32:11.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.440258ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20582025-01-17T08:32:11.978ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.457625ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20592025-01-17T08:32:11.979ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20602025-01-17T08:32:11.979ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20612025-01-17T08:32:11.979ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20622025-01-17T08:32:11.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20632025-01-17T08:32:11.981ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 97.807154ms iteration = 20 status = {"physical_disks_added":0}
20642025-01-17T08:32:12.004ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
20652025-01-17T08:32:12.004ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 121.755404ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20662025-01-17T08:32:12.009ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20672025-01-17T08:32:12.009ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20682025-01-17T08:32:12.009ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.308692ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20692025-01-17T08:32:12.043ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
20702025-01-17T08:32:12.043ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20712025-01-17T08:32:12.044ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9138678-3477-4bcc-85e0-c4ebe0193df9", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
20722025-01-17T08:32:12.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20732025-01-17T08:32:12.045ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20742025-01-17T08:32:12.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20752025-01-17T08:32:12.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20762025-01-17T08:32:12.068ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.543398ms iteration = 18 status = {}
20772025-01-17T08:32:12.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20782025-01-17T08:32:12.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20792025-01-17T08:32:12.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20802025-01-17T08:32:12.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20812025-01-17T08:32:12.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822025-01-17T08:32:12.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20832025-01-17T08:32:12.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20842025-01-17T08:32:12.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20852025-01-17T08:32:12.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
20862025-01-17T08:32:12.156ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20872025-01-17T08:32:12.157ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25dbd88b-7d4b-470f-9a67-68f7810614a5", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
20882025-01-17T08:32:12.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20892025-01-17T08:32:12.157ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20902025-01-17T08:32:12.158ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc218199-0465-4000-9ab9-2dc2b69ff69e", "content-length": "1", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
20912025-01-17T08:32:12.159ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20922025-01-17T08:32:12.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20932025-01-17T08:32:12.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
20942025-01-17T08:32:12.189ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20952025-01-17T08:32:12.189ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20962025-01-17T08:32:12.189ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "768cd846-0ff5-48e1-b2e8-11802f7fa575", "content-length": "372", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
20972025-01-17T08:32:12.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20982025-01-17T08:32:12.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20992025-01-17T08:32:12.190ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21002025-01-17T08:32:12.190ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e517bdf-961c-43dc-ae6f-a506b8f0299a", "content-length": "691", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21012025-01-17T08:32:12.190ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21022025-01-17T08:32:12.190ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21032025-01-17T08:32:12.190ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21042025-01-17T08:32:12.191ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.925646ms iteration = 18 status = null
21052025-01-17T08:32:12.192ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 308.957085ms iteration = 18 status = {}
21062025-01-17T08:32:12.232ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21072025-01-17T08:32:12.232ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21082025-01-17T08:32:12.232ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd3dd1fe-bd2b-49e9-b969-b31896e16347", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21092025-01-17T08:32:12.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21102025-01-17T08:32:12.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21112025-01-17T08:32:12.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21122025-01-17T08:32:12.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21132025-01-17T08:32:12.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21142025-01-17T08:32:12.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21152025-01-17T08:32:12.241ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21162025-01-17T08:32:12.241ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21172025-01-17T08:32:12.242ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b41a47c1-69b3-4456-be28-7e62e5f78ce9", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21182025-01-17T08:32:12.244ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 354.750627ms iteration = 18 status = {}
21192025-01-17T08:32:12.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21202025-01-17T08:32:12.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21212025-01-17T08:32:12.270ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
21222025-01-17T08:32:12.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21232025-01-17T08:32:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21242025-01-17T08:32:12.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21252025-01-17T08:32:12.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f83ef1d-c448-4851-a72a-f6911cc30035", "content-length": "134", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21262025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21272025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
21282025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21292025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21302025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21312025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21322025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21332025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21342025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21352025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21362025-01-17T08:32:12.280ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
21372025-01-17T08:32:12.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21382025-01-17T08:32:12.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21392025-01-17T08:32:12.282ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21402025-01-17T08:32:12.282ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "71c7e165-f680-44e6-a964-7b89204d3afe", "content-length": "2", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21412025-01-17T08:32:12.282ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21422025-01-17T08:32:12.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b9d41f2-2f73-49c9-98ad-6ed83b06f5cb", "content-length": "52", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21432025-01-17T08:32:12.283ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
21442025-01-17T08:32:12.283ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21452025-01-17T08:32:12.380ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8b730487-d802-4397-98d8-20fecd18a523", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21462025-01-17T08:32:12.380ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
21472025-01-17T08:32:12.380ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21482025-01-17T08:32:12.383ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7efbad11-d4b6-4024-bbcd-966c7326d649", "content-length": "682", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21492025-01-17T08:32:12.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21502025-01-17T08:32:12.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21512025-01-17T08:32:12.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21522025-01-17T08:32:12.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21532025-01-17T08:32:12.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21542025-01-17T08:32:12.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21552025-01-17T08:32:12.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21562025-01-17T08:32:12.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21572025-01-17T08:32:12.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d6d9f817-f7fd-4895-bb1f-65a38d86bd87 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21582025-01-17T08:32:12.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d6d9f817-f7fd-4895-bb1f-65a38d86bd87 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21592025-01-17T08:32:12.400ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 517.449174ms iteration = 18 status = {}
21602025-01-17T08:32:12.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d6d9f817-f7fd-4895-bb1f-65a38d86bd87 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21612025-01-17T08:32:12.581ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21622025-01-17T08:32:12.581ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
21632025-01-17T08:32:12.611ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
21642025-01-17T08:32:12.611ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:55334
21652025-01-17T08:32:12.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:55334 req_id = cd503723-7811-4711-b3d7-466672db6134 roles = RoleSet { roles: {} } uri = /metrics/producers
21662025-01-17T08:32:12.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:55334 req_id = cd503723-7811-4711-b3d7-466672db6134 resource = Database result = Ok(()) uri = /metrics/producers
21672025-01-17T08:32:12.650ZINFOnexus: assigned collector to new producer collector_id = 0cc45a67-34ed-4014-ae46-f6e108da31b8 file = nexus/src/app/oximeter.rs:76 producer_id = b72586ef-ab31-4002-9c99-4f4040a5f525
21682025-01-17T08:32:12.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38660 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:55334 req_id = cd503723-7811-4711-b3d7-466672db6134 response_code = 201 uri = /metrics/producers
21692025-01-17T08:32:12.650ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd503723-7811-4711-b3d7-466672db6134", "content-length": "41", "date": "Fri, 17 Jan 2025 08:32:11 GMT"} })
21702025-01-17T08:32:12.652ZDEBGnexus (producer-registration-task): registered with nexus successfully
21712025-01-17T08:32:12.652ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21722025-01-17T08:32:12.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2122d2f7-df53-4b67-9663-84b9acd94dd9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21732025-01-17T08:32:12.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2122d2f7-df53-4b67-9663-84b9acd94dd9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21742025-01-17T08:32:12.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2122d2f7-df53-4b67-9663-84b9acd94dd9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21752025-01-17T08:32:13.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 44c91766-906d-4c1f-befb-b54d14db4b93 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
21762025-01-17T08:32:13.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 659b5e77-8854-4f0b-a48c-5c9f5bd0466b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21772025-01-17T08:32:13.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 659b5e77-8854-4f0b-a48c-5c9f5bd0466b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21782025-01-17T08:32:13.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 659b5e77-8854-4f0b-a48c-5c9f5bd0466b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21792025-01-17T08:32:14.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 617739f2-7bf6-4c5b-b0dd-3291fd329c84 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21802025-01-17T08:32:14.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 617739f2-7bf6-4c5b-b0dd-3291fd329c84 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21812025-01-17T08:32:14.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 617739f2-7bf6-4c5b-b0dd-3291fd329c84 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21822025-01-17T08:32:16.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 98078fc0-3924-4081-9783-1d66b9f44063 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21832025-01-17T08:32:16.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 98078fc0-3924-4081-9783-1d66b9f44063 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21842025-01-17T08:32:16.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 98078fc0-3924-4081-9783-1d66b9f44063 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21852025-01-17T08:32:17.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3951f9a5-0c88-486a-bbdb-0e30d030658b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21862025-01-17T08:32:17.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3951f9a5-0c88-486a-bbdb-0e30d030658b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21872025-01-17T08:32:17.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3951f9a5-0c88-486a-bbdb-0e30d030658b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21882025-01-17T08:32:18.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a878c7fd-ab7d-4bee-b280-5f2293ed8356 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21892025-01-17T08:32:18.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a878c7fd-ab7d-4bee-b280-5f2293ed8356 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21902025-01-17T08:32:18.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a878c7fd-ab7d-4bee-b280-5f2293ed8356 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21912025-01-17T08:32:19.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cad255db-061d-440c-8d80-842843cacc7d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21922025-01-17T08:32:19.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cad255db-061d-440c-8d80-842843cacc7d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21932025-01-17T08:32:19.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cad255db-061d-440c-8d80-842843cacc7d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21942025-01-17T08:32:20.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 114e7447-c1f3-4602-9e1c-f2d6192bc00b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21952025-01-17T08:32:20.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 114e7447-c1f3-4602-9e1c-f2d6192bc00b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21962025-01-17T08:32:20.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 114e7447-c1f3-4602-9e1c-f2d6192bc00b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21972025-01-17T08:32:21.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d95254b-b777-4070-8fb7-cb7852edda07 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21982025-01-17T08:32:21.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d95254b-b777-4070-8fb7-cb7852edda07 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21992025-01-17T08:32:21.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d95254b-b777-4070-8fb7-cb7852edda07 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22002025-01-17T08:32:21.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
22012025-01-17T08:32:21.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22022025-01-17T08:32:21.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22032025-01-17T08:32:21.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042025-01-17T08:32:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22052025-01-17T08:32:21.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22062025-01-17T08:32:21.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22072025-01-17T08:32:21.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
22082025-01-17T08:32:21.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22092025-01-17T08:32:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22102025-01-17T08:32:21.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22112025-01-17T08:32:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22122025-01-17T08:32:21.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22132025-01-17T08:32:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22142025-01-17T08:32:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22152025-01-17T08:32:21.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.590248ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22162025-01-17T08:32:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
22172025-01-17T08:32:21.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22182025-01-17T08:32:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22192025-01-17T08:32:21.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
22202025-01-17T08:32:21.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.648359ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
22212025-01-17T08:32:22.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3f297a59-04cb-4e30-8442-0de026390f1e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22222025-01-17T08:32:22.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3f297a59-04cb-4e30-8442-0de026390f1e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22232025-01-17T08:32:22.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3f297a59-04cb-4e30-8442-0de026390f1e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22242025-01-17T08:32:23.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9c2c03d-1d39-44b2-9294-ee4ef6bc6e85 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22252025-01-17T08:32:23.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9c2c03d-1d39-44b2-9294-ee4ef6bc6e85 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22262025-01-17T08:32:23.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9c2c03d-1d39-44b2-9294-ee4ef6bc6e85 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22272025-01-17T08:32:23.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 628 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 402fa148-6b52-4b4f-bb5f-00c1d6114fd6 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
22282025-01-17T08:32:24.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abf7db35-3abf-4a32-9d68-30f21dca4848 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22292025-01-17T08:32:24.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abf7db35-3abf-4a32-9d68-30f21dca4848 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22302025-01-17T08:32:24.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = abf7db35-3abf-4a32-9d68-30f21dca4848 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22312025-01-17T08:32:25.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ff65558c-d089-4d41-9090-c4577915c224 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22322025-01-17T08:32:25.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ff65558c-d089-4d41-9090-c4577915c224 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22332025-01-17T08:32:25.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ff65558c-d089-4d41-9090-c4577915c224 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22342025-01-17T08:32:26.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca6a582c-8a6d-4be8-af80-1a655db500cd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22352025-01-17T08:32:26.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca6a582c-8a6d-4be8-af80-1a655db500cd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22362025-01-17T08:32:26.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca6a582c-8a6d-4be8-af80-1a655db500cd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22372025-01-17T08:32:27.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7db4258-c979-4d8a-9afa-2ec66af18aa0 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22382025-01-17T08:32:27.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7db4258-c979-4d8a-9afa-2ec66af18aa0 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22392025-01-17T08:32:27.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7db4258-c979-4d8a-9afa-2ec66af18aa0 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22402025-01-17T08:32:28.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73bcaafe-5073-48f9-af01-92c93179e094 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22412025-01-17T08:32:28.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73bcaafe-5073-48f9-af01-92c93179e094 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22422025-01-17T08:32:28.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73bcaafe-5073-48f9-af01-92c93179e094 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22432025-01-17T08:32:29.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e38bb0fe-2523-4337-9537-bfc0e6d7c3ed roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22442025-01-17T08:32:29.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e38bb0fe-2523-4337-9537-bfc0e6d7c3ed resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22452025-01-17T08:32:29.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e38bb0fe-2523-4337-9537-bfc0e6d7c3ed response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22462025-01-17T08:32:30.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8acf7339-1fda-441a-b558-54d84105f1d2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22472025-01-17T08:32:30.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8acf7339-1fda-441a-b558-54d84105f1d2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22482025-01-17T08:32:30.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8acf7339-1fda-441a-b558-54d84105f1d2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22492025-01-17T08:32:31.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 944ecda5-cc4e-4d57-b5cb-d3861b090606 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22502025-01-17T08:32:31.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 944ecda5-cc4e-4d57-b5cb-d3861b090606 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22512025-01-17T08:32:31.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 944ecda5-cc4e-4d57-b5cb-d3861b090606 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22522025-01-17T08:32:31.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
22532025-01-17T08:32:31.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22542025-01-17T08:32:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22552025-01-17T08:32:31.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22562025-01-17T08:32:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22572025-01-17T08:32:31.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22582025-01-17T08:32:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22592025-01-17T08:32:31.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
22602025-01-17T08:32:31.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22612025-01-17T08:32:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22622025-01-17T08:32:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22632025-01-17T08:32:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22642025-01-17T08:32:31.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652025-01-17T08:32:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
22662025-01-17T08:32:31.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22672025-01-17T08:32:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22682025-01-17T08:32:31.903ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
22692025-01-17T08:32:31.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.578004ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
22702025-01-17T08:32:31.918ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22712025-01-17T08:32:31.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22722025-01-17T08:32:31.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.24931ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22732025-01-17T08:32:32.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = af5c2e6e-2b6f-48bb-9eda-b1d38d923957 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22742025-01-17T08:32:32.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = af5c2e6e-2b6f-48bb-9eda-b1d38d923957 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22752025-01-17T08:32:32.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = af5c2e6e-2b6f-48bb-9eda-b1d38d923957 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22762025-01-17T08:32:33.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 694c6c85-308a-4a46-8550-c35507a0bbeb roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22772025-01-17T08:32:33.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 694c6c85-308a-4a46-8550-c35507a0bbeb resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22782025-01-17T08:32:33.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 694c6c85-308a-4a46-8550-c35507a0bbeb response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22792025-01-17T08:32:33.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = e4d0f2e8-2b97-493b-89aa-ff2470901ef4 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
22802025-01-17T08:32:34.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f094de0f-ec97-4b3a-92e1-0ed6f87c4f1e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22812025-01-17T08:32:34.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f094de0f-ec97-4b3a-92e1-0ed6f87c4f1e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22822025-01-17T08:32:34.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f094de0f-ec97-4b3a-92e1-0ed6f87c4f1e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22832025-01-17T08:32:35.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 933c9b03-75b4-4dc6-a052-0d022b7e8a56 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22842025-01-17T08:32:35.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 933c9b03-75b4-4dc6-a052-0d022b7e8a56 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22852025-01-17T08:32:35.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 933c9b03-75b4-4dc6-a052-0d022b7e8a56 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22862025-01-17T08:32:36.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2b5a59dd-aeed-4c56-bf9b-cf5490504f52 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22872025-01-17T08:32:36.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2b5a59dd-aeed-4c56-bf9b-cf5490504f52 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22882025-01-17T08:32:36.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2b5a59dd-aeed-4c56-bf9b-cf5490504f52 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22892025-01-17T08:32:37.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3508ab27-311c-476a-9b29-5717b3038500 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22902025-01-17T08:32:37.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3508ab27-311c-476a-9b29-5717b3038500 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22912025-01-17T08:32:37.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3508ab27-311c-476a-9b29-5717b3038500 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22922025-01-17T08:32:38.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c9aebd15-9800-41bb-a95d-b4c253948f8f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22932025-01-17T08:32:38.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c9aebd15-9800-41bb-a95d-b4c253948f8f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22942025-01-17T08:32:38.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c9aebd15-9800-41bb-a95d-b4c253948f8f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22952025-01-17T08:32:39.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 77ae4ea1-8e33-4e53-ad25-1256eb590686 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22962025-01-17T08:32:39.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 77ae4ea1-8e33-4e53-ad25-1256eb590686 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22972025-01-17T08:32:39.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 77ae4ea1-8e33-4e53-ad25-1256eb590686 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22982025-01-17T08:32:40.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7678098-d297-48f7-a317-9e4c56a14353 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22992025-01-17T08:32:40.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7678098-d297-48f7-a317-9e4c56a14353 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23002025-01-17T08:32:40.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7678098-d297-48f7-a317-9e4c56a14353 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23012025-01-17T08:32:41.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e22e439-f5ff-4d10-89d3-eb5f1d8444b2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23022025-01-17T08:32:41.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e22e439-f5ff-4d10-89d3-eb5f1d8444b2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23032025-01-17T08:32:41.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e22e439-f5ff-4d10-89d3-eb5f1d8444b2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23042025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
23052025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
23062025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23072025-01-17T08:32:41.882ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:22:41.882531147 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23082025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23092025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23102025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
23112025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
23122025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
23132025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
23142025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23152025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23162025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
23172025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23182025-01-17T08:32:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23192025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23202025-01-17T08:32:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 58115317 } })
23212025-01-17T08:32:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 58183358 } })
23222025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23232025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
23242025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
23252025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
23262025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
23272025-01-17T08:32:41.883ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23282025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23292025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23302025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23312025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
23322025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23332025-01-17T08:32:41.883ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
23342025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.55\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
23352025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
23362025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
23372025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23382025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
23392025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
23402025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23412025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23422025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23432025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
23442025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
23452025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
23462025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23472025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23482025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
23492025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23502025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
23512025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23522025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23532025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
23542025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.031039ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
23552025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23562025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23572025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.057578ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23582025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23592025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23602025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23612025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23622025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23632025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23642025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23652025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23662025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23672025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23682025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23692025-01-17T08:32:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23702025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23712025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23722025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23732025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23742025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23752025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23762025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23772025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23782025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23792025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
23802025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23812025-01-17T08:32:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23822025-01-17T08:32:41.885ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:22:41.882531147 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23832025-01-17T08:32:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.209765ms iteration = 10 status = {"expiration":"2025-01-17T08:22:41.882531147Z","pruned":[]}
23842025-01-17T08:32:41.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23852025-01-17T08:32:41.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862025-01-17T08:32:41.888ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.959349ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23872025-01-17T08:32:41.888ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23882025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23892025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23902025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23912025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
23922025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23932025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
23942025-01-17T08:32:41.889ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23952025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23962025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23972025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
23982025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23992025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
24002025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24012025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24022025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24032025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24042025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24052025-01-17T08:32:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24062025-01-17T08:32:41.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24072025-01-17T08:32:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24082025-01-17T08:32:41.890ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24092025-01-17T08:32:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24102025-01-17T08:32:41.891ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-01-17T08:32:41.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 67151119 } })
24122025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
24132025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
24142025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24152025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
24162025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24172025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
24182025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24192025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24202025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
24212025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24222025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
24232025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24242025-01-17T08:32:41.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
24252025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24262025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24272025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24282025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24292025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24302025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24312025-01-17T08:32:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24322025-01-17T08:32:41.893ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 68206857 } })
24332025-01-17T08:32:41.893ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
24342025-01-17T08:32:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24352025-01-17T08:32:41.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24362025-01-17T08:32:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24372025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24382025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24392025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24412025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24422025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24432025-01-17T08:32:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24442025-01-17T08:32:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24452025-01-17T08:32:41.898ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24462025-01-17T08:32:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24472025-01-17T08:32:41.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24482025-01-17T08:32:41.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492025-01-17T08:32:41.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502025-01-17T08:32:41.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24512025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24532025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24542025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24552025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24562025-01-17T08:32:41.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572025-01-17T08:32:41.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24582025-01-17T08:32:41.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24592025-01-17T08:32:41.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24602025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24612025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24622025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24632025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24642025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24652025-01-17T08:32:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24662025-01-17T08:32:41.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24672025-01-17T08:32:41.910ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24682025-01-17T08:32:41.910ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24692025-01-17T08:32:41.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24702025-01-17T08:32:41.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24712025-01-17T08:32:41.914ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.112235ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
24722025-01-17T08:32:41.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24732025-01-17T08:32:41.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24742025-01-17T08:32:41.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24752025-01-17T08:32:41.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24762025-01-17T08:32:41.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24772025-01-17T08:32:41.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24782025-01-17T08:32:41.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24792025-01-17T08:32:41.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24802025-01-17T08:32:41.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24812025-01-17T08:32:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24822025-01-17T08:32:41.930ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24832025-01-17T08:32:41.930ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.156345ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24842025-01-17T08:32:41.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24852025-01-17T08:32:41.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24862025-01-17T08:32:41.932ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872025-01-17T08:32:41.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24882025-01-17T08:32:41.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24892025-01-17T08:32:41.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24902025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24912025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24922025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24932025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24942025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24952025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24962025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24972025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24982025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24992025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25002025-01-17T08:32:41.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25012025-01-17T08:32:41.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022025-01-17T08:32:41.938ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25032025-01-17T08:32:41.938ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25042025-01-17T08:32:41.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25052025-01-17T08:32:41.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25062025-01-17T08:32:41.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
25072025-01-17T08:32:41.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25082025-01-17T08:32:41.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25092025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25102025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25112025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25122025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25132025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25142025-01-17T08:32:41.943ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25152025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 60.523499ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25162025-01-17T08:32:41.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25172025-01-17T08:32:41.949ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25182025-01-17T08:32:41.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25192025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25212025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25222025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25232025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25242025-01-17T08:32:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25252025-01-17T08:32:41.950ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1871, tv_nsec: 125975044 } })
25262025-01-17T08:32:41.951ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
25272025-01-17T08:32:41.951ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282025-01-17T08:32:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25292025-01-17T08:32:41.953ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25302025-01-17T08:32:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25312025-01-17T08:32:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25322025-01-17T08:32:41.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25332025-01-17T08:32:41.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25342025-01-17T08:32:41.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25352025-01-17T08:32:41.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25362025-01-17T08:32:41.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25372025-01-17T08:32:41.958ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25382025-01-17T08:32:41.959ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25392025-01-17T08:32:41.959ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.059765ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25402025-01-17T08:32:41.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.058491ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
25412025-01-17T08:32:41.962ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 79.58967ms iteration = 5 status = {"nsuccess":5}
25422025-01-17T08:32:41.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25432025-01-17T08:32:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25442025-01-17T08:32:41.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.674415ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
25452025-01-17T08:32:41.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25462025-01-17T08:32:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25472025-01-17T08:32:41.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25482025-01-17T08:32:41.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25492025-01-17T08:32:41.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25502025-01-17T08:32:41.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 75.479628ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25512025-01-17T08:32:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25522025-01-17T08:32:41.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25532025-01-17T08:32:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25542025-01-17T08:32:41.971ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.992495ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25552025-01-17T08:32:41.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
25562025-01-17T08:32:41.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.841351ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
25572025-01-17T08:32:41.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25582025-01-17T08:32:41.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25592025-01-17T08:32:41.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25602025-01-17T08:32:41.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25612025-01-17T08:32:41.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25622025-01-17T08:32:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
25632025-01-17T08:32:41.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25642025-01-17T08:32:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25652025-01-17T08:32:41.986ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.428188ms iteration = 19 status = 0
25662025-01-17T08:32:41.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25672025-01-17T08:32:41.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25682025-01-17T08:32:41.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25692025-01-17T08:32:41.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25702025-01-17T08:32:41.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25712025-01-17T08:32:41.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25722025-01-17T08:32:41.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25732025-01-17T08:32:41.995ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25742025-01-17T08:32:41.995ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25752025-01-17T08:32:41.995ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.544073ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25762025-01-17T08:32:41.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.806651ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25772025-01-17T08:32:42.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25782025-01-17T08:32:42.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25792025-01-17T08:32:42.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25802025-01-17T08:32:42.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.895203ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25812025-01-17T08:32:42.002ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25822025-01-17T08:32:42.002ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
25832025-01-17T08:32:42.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25842025-01-17T08:32:42.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25852025-01-17T08:32:42.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25862025-01-17T08:32:42.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25872025-01-17T08:32:42.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25882025-01-17T08:32:42.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25892025-01-17T08:32:42.006ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25902025-01-17T08:32:42.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912025-01-17T08:32:42.007ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.413994ms iteration = 21 status = {"physical_disks_added":0}
25922025-01-17T08:32:42.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25932025-01-17T08:32:42.008ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25942025-01-17T08:32:42.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25952025-01-17T08:32:42.010ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
25962025-01-17T08:32:42.010ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 126.788053ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
25972025-01-17T08:32:42.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25982025-01-17T08:32:42.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25992025-01-17T08:32:42.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26002025-01-17T08:32:42.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
26012025-01-17T08:32:42.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26022025-01-17T08:32:42.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
26032025-01-17T08:32:42.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 129.588325ms iteration = 10 status = {"generation":2}
26042025-01-17T08:32:42.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26052025-01-17T08:32:42.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26062025-01-17T08:32:42.038ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
26072025-01-17T08:32:42.038ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 155.611081ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26082025-01-17T08:32:42.041ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26092025-01-17T08:32:42.041ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26102025-01-17T08:32:42.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26112025-01-17T08:32:42.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26122025-01-17T08:32:42.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26132025-01-17T08:32:42.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26142025-01-17T08:32:42.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26152025-01-17T08:32:42.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26162025-01-17T08:32:42.059ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26172025-01-17T08:32:42.059ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26182025-01-17T08:32:42.059ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
26192025-01-17T08:32:42.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 177.396103ms iteration = 10 status = {"generation":1}
26202025-01-17T08:32:42.077ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26212025-01-17T08:32:42.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.921707ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26222025-01-17T08:32:42.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26232025-01-17T08:32:42.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26242025-01-17T08:32:42.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26252025-01-17T08:32:42.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26262025-01-17T08:32:42.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26272025-01-17T08:32:42.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26282025-01-17T08:32:42.114ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
26292025-01-17T08:32:42.114ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26302025-01-17T08:32:42.114ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d5d26ab-5dfd-46dc-a1f2-41c9383e76a3", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
26312025-01-17T08:32:42.114ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26322025-01-17T08:32:42.117ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
26332025-01-17T08:32:42.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
26342025-01-17T08:32:42.149ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26352025-01-17T08:32:42.149ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78ee0aa4-794a-4d61-9fc8-61b468a4906b", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
26362025-01-17T08:32:42.149ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26372025-01-17T08:32:42.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26382025-01-17T08:32:42.155ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26392025-01-17T08:32:42.155ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5f1046a6-0dd0-478d-ab79-2f18ca2de15c", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26402025-01-17T08:32:42.155ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26412025-01-17T08:32:42.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d04aa3a3-ba53-4abc-97a1-aaeed594b768", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26422025-01-17T08:32:42.157ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26432025-01-17T08:32:42.159ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26442025-01-17T08:32:42.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 276.814801ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26452025-01-17T08:32:42.161ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
26462025-01-17T08:32:42.161ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26472025-01-17T08:32:42.161ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a49675ee-d193-487e-b5ed-b7fe3f30202b", "content-length": "26", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
26482025-01-17T08:32:42.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26492025-01-17T08:32:42.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26502025-01-17T08:32:42.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26512025-01-17T08:32:42.176ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26522025-01-17T08:32:42.176ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26532025-01-17T08:32:42.177ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "618c1658-4a49-41f2-a6f0-44fe24dd639e", "content-length": "372", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
26542025-01-17T08:32:42.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26552025-01-17T08:32:42.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26562025-01-17T08:32:42.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26572025-01-17T08:32:42.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26582025-01-17T08:32:42.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26592025-01-17T08:32:42.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26602025-01-17T08:32:42.221ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26612025-01-17T08:32:42.221ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26622025-01-17T08:32:42.221ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "81faee38-d514-46e8-a612-5fd5c2d54986", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
26632025-01-17T08:32:42.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26642025-01-17T08:32:42.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26652025-01-17T08:32:42.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26662025-01-17T08:32:42.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26672025-01-17T08:32:42.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26682025-01-17T08:32:42.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26692025-01-17T08:32:42.408ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26702025-01-17T08:32:42.408ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c3d9510-d6f8-4a81-a4bd-5f8ba3db6a92", "content-length": "1", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
26712025-01-17T08:32:42.410ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26722025-01-17T08:32:42.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26732025-01-17T08:32:42.426ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 542.884536ms iteration = 19 status = {}
26742025-01-17T08:32:42.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 47ecb8f3-19fa-40c3-9560-788b47659c04 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26752025-01-17T08:32:42.435ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26762025-01-17T08:32:42.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 47ecb8f3-19fa-40c3-9560-788b47659c04 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26772025-01-17T08:32:42.435ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a6f661f3-2fa9-4d77-9865-6d0898d65293", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26782025-01-17T08:32:42.435ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26792025-01-17T08:32:42.436ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26802025-01-17T08:32:42.438ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c59b99-e40d-4d0d-8525-1e2fbe2d4def", "content-length": "691", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
26812025-01-17T08:32:42.438ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26822025-01-17T08:32:42.438ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26832025-01-17T08:32:42.438ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26842025-01-17T08:32:42.439ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 555.881348ms iteration = 19 status = {}
26852025-01-17T08:32:42.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "66da9b49-0f95-4d61-8902-99ccbd43b184", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26862025-01-17T08:32:42.440ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26872025-01-17T08:32:42.441ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 558.391579ms iteration = 19 status = null
26882025-01-17T08:32:42.442ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e8d3cabd-c224-4a0e-b9db-4e00c0667c8f", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26892025-01-17T08:32:42.442ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26902025-01-17T08:32:42.443ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26912025-01-17T08:32:42.443ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26922025-01-17T08:32:42.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8823 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 47ecb8f3-19fa-40c3-9560-788b47659c04 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26932025-01-17T08:32:42.444ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ce03e09-5e32-4f92-becb-e78dc59b3b98", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
26942025-01-17T08:32:42.444ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26952025-01-17T08:32:42.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.202549ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26962025-01-17T08:32:42.446ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 557.184109ms iteration = 19 status = {}
26972025-01-17T08:32:42.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26982025-01-17T08:32:42.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26992025-01-17T08:32:42.466ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
27002025-01-17T08:32:42.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27012025-01-17T08:32:42.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27022025-01-17T08:32:42.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27032025-01-17T08:32:42.475ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8224006d-ccd8-488f-a4ea-149f56ebc9c9", "content-length": "134", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
27042025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27052025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
27062025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27072025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27082025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27092025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27102025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27112025-01-17T08:32:42.475ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27122025-01-17T08:32:42.476ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27132025-01-17T08:32:42.476ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27142025-01-17T08:32:42.476ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
27152025-01-17T08:32:42.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27162025-01-17T08:32:42.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27172025-01-17T08:32:42.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27182025-01-17T08:32:42.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf08bbd5-ca1c-4421-b995-2dbf79675bf5", "content-length": "2", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
27192025-01-17T08:32:42.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27202025-01-17T08:32:42.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a1c6db-2d98-44c4-bf03-eadf1e8cde92", "content-length": "52", "date": "Fri, 17 Jan 2025 08:32:42 GMT"} })
27212025-01-17T08:32:42.478ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
27222025-01-17T08:32:42.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27232025-01-17T08:32:42.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3ad2da95-49f5-4cd8-890a-0fdeaf345869", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
27242025-01-17T08:32:42.569ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
27252025-01-17T08:32:42.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27262025-01-17T08:32:42.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "46303ddf-ec1a-4217-b33d-f901af52d9eb", "content-length": "682", "date": "Fri, 17 Jan 2025 08:32:41 GMT"} })
27272025-01-17T08:32:42.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27282025-01-17T08:32:42.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27292025-01-17T08:32:42.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27302025-01-17T08:32:42.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27312025-01-17T08:32:42.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27322025-01-17T08:32:42.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27332025-01-17T08:32:42.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342025-01-17T08:32:42.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27352025-01-17T08:32:42.586ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.818161ms iteration = 19 status = {}
27362025-01-17T08:32:42.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06e94fd5-a522-4331-aab0-6e26fd14c5a3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27372025-01-17T08:32:42.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06e94fd5-a522-4331-aab0-6e26fd14c5a3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27382025-01-17T08:32:42.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 06e94fd5-a522-4331-aab0-6e26fd14c5a3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27392025-01-17T08:32:43.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 544 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 62386b72-8283-4f53-ba9f-b743c60eabfd response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
27402025-01-17T08:32:43.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 96e325f8-3893-4c22-b7b5-2a8362b087df roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27412025-01-17T08:32:43.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 96e325f8-3893-4c22-b7b5-2a8362b087df resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27422025-01-17T08:32:43.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 96e325f8-3893-4c22-b7b5-2a8362b087df response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27432025-01-17T08:32:44.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b1d65dd4-06ed-4aab-ab0f-a4b3f524014b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27442025-01-17T08:32:44.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b1d65dd4-06ed-4aab-ab0f-a4b3f524014b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27452025-01-17T08:32:44.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b1d65dd4-06ed-4aab-ab0f-a4b3f524014b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27462025-01-17T08:32:45.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 23f1e074-a77a-448a-b95f-4bfcb952fb1b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27472025-01-17T08:32:45.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 23f1e074-a77a-448a-b95f-4bfcb952fb1b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27482025-01-17T08:32:45.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 23f1e074-a77a-448a-b95f-4bfcb952fb1b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27492025-01-17T08:32:46.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dedc6f3c-7b9d-4212-b90c-976a88dcca1a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27502025-01-17T08:32:46.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dedc6f3c-7b9d-4212-b90c-976a88dcca1a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27512025-01-17T08:32:46.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dedc6f3c-7b9d-4212-b90c-976a88dcca1a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27522025-01-17T08:32:47.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3ba7a5ba-3ba8-4407-b3f0-dbc534134fac roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27532025-01-17T08:32:47.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3ba7a5ba-3ba8-4407-b3f0-dbc534134fac resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27542025-01-17T08:32:47.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3ba7a5ba-3ba8-4407-b3f0-dbc534134fac response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27552025-01-17T08:32:48.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f349001-ced1-401a-8eca-d888c0d27f86 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27562025-01-17T08:32:48.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f349001-ced1-401a-8eca-d888c0d27f86 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27572025-01-17T08:32:48.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2810 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4f349001-ced1-401a-8eca-d888c0d27f86 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27582025-01-17T08:32:49.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213934cd-24c0-4d4d-b78f-eb3379fe8fe3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27592025-01-17T08:32:49.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213934cd-24c0-4d4d-b78f-eb3379fe8fe3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27602025-01-17T08:32:49.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213934cd-24c0-4d4d-b78f-eb3379fe8fe3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27612025-01-17T08:32:50.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca83ea14-c0e2-4ff5-bc38-0849c54befab roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27622025-01-17T08:32:50.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca83ea14-c0e2-4ff5-bc38-0849c54befab resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27632025-01-17T08:32:50.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca83ea14-c0e2-4ff5-bc38-0849c54befab response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27642025-01-17T08:32:51.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d4b61b3-da43-4156-89ed-532cc92f378e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27652025-01-17T08:32:51.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d4b61b3-da43-4156-89ed-532cc92f378e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27662025-01-17T08:32:51.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0d4b61b3-da43-4156-89ed-532cc92f378e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27672025-01-17T08:32:51.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
27682025-01-17T08:32:51.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692025-01-17T08:32:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27702025-01-17T08:32:51.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
27712025-01-17T08:32:51.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27722025-01-17T08:32:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27732025-01-17T08:32:51.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27742025-01-17T08:32:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27752025-01-17T08:32:51.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27762025-01-17T08:32:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27772025-01-17T08:32:51.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27782025-01-17T08:32:51.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27792025-01-17T08:32:51.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27802025-01-17T08:32:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
27812025-01-17T08:32:51.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27822025-01-17T08:32:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27832025-01-17T08:32:51.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27842025-01-17T08:32:51.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27852025-01-17T08:32:51.935ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
27862025-01-17T08:32:51.935ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.466055ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
27872025-01-17T08:32:51.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.365865ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27882025-01-17T08:32:52.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9c1ca1c9-ee0a-4335-9a16-56aea222c1de roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27892025-01-17T08:32:52.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9c1ca1c9-ee0a-4335-9a16-56aea222c1de resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27902025-01-17T08:32:52.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9c1ca1c9-ee0a-4335-9a16-56aea222c1de response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27912025-01-17T08:32:53.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = ae850970-ea24-4786-9831-5e443b3a07af response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
27922025-01-17T08:32:53.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 11c9a4ca-6702-4db0-9bb4-71114c7d2b20 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27932025-01-17T08:32:53.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 11c9a4ca-6702-4db0-9bb4-71114c7d2b20 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27942025-01-17T08:32:53.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 11c9a4ca-6702-4db0-9bb4-71114c7d2b20 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27952025-01-17T08:32:54.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba0d9ff5-d4ca-4427-95cb-51713bc28371 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27962025-01-17T08:32:54.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba0d9ff5-d4ca-4427-95cb-51713bc28371 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27972025-01-17T08:32:54.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba0d9ff5-d4ca-4427-95cb-51713bc28371 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27982025-01-17T08:32:55.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d8eaf014-1708-4f24-9019-2dff468c244b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27992025-01-17T08:32:55.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d8eaf014-1708-4f24-9019-2dff468c244b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28002025-01-17T08:32:55.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d8eaf014-1708-4f24-9019-2dff468c244b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28012025-01-17T08:32:56.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 140ab136-6b51-4d5f-8116-eccd9e7c0efc roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28022025-01-17T08:32:56.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 140ab136-6b51-4d5f-8116-eccd9e7c0efc resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28032025-01-17T08:32:56.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 140ab136-6b51-4d5f-8116-eccd9e7c0efc response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28042025-01-17T08:32:57.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 29ad7efa-7c76-4135-a0ae-f011d35e8219 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28052025-01-17T08:32:57.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 29ad7efa-7c76-4135-a0ae-f011d35e8219 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28062025-01-17T08:32:57.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 29ad7efa-7c76-4135-a0ae-f011d35e8219 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28072025-01-17T08:32:58.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ec6dbaf-5705-4d0c-a2a0-e858f68548e7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28082025-01-17T08:32:58.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ec6dbaf-5705-4d0c-a2a0-e858f68548e7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28092025-01-17T08:32:58.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6ec6dbaf-5705-4d0c-a2a0-e858f68548e7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28102025-01-17T08:33:00.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 557ac32d-6db0-4d10-bfdd-8713d6abd7a8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28112025-01-17T08:33:00.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 557ac32d-6db0-4d10-bfdd-8713d6abd7a8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28122025-01-17T08:33:00.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 557ac32d-6db0-4d10-bfdd-8713d6abd7a8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28132025-01-17T08:33:01.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffa784b0-f8ee-4fcd-9a02-3bac3d6841f3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28142025-01-17T08:33:01.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffa784b0-f8ee-4fcd-9a02-3bac3d6841f3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28152025-01-17T08:33:01.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ffa784b0-f8ee-4fcd-9a02-3bac3d6841f3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28162025-01-17T08:33:01.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
28172025-01-17T08:33:01.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28182025-01-17T08:33:01.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28192025-01-17T08:33:01.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28202025-01-17T08:33:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28212025-01-17T08:33:01.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222025-01-17T08:33:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232025-01-17T08:33:01.889ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
28242025-01-17T08:33:01.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28252025-01-17T08:33:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28262025-01-17T08:33:01.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28272025-01-17T08:33:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28282025-01-17T08:33:01.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28292025-01-17T08:33:01.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
28302025-01-17T08:33:01.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28312025-01-17T08:33:01.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28322025-01-17T08:33:01.902ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
28332025-01-17T08:33:01.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.856361ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
28342025-01-17T08:33:01.918ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28352025-01-17T08:33:01.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28362025-01-17T08:33:01.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.959707ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28372025-01-17T08:33:02.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c740440c-5162-464f-ba1c-91993a445d14 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28382025-01-17T08:33:02.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c740440c-5162-464f-ba1c-91993a445d14 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28392025-01-17T08:33:02.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c740440c-5162-464f-ba1c-91993a445d14 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28402025-01-17T08:33:03.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9bc588f-0513-4069-a65a-19ca76dd2a5d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28412025-01-17T08:33:03.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9bc588f-0513-4069-a65a-19ca76dd2a5d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28422025-01-17T08:33:03.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9bc588f-0513-4069-a65a-19ca76dd2a5d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28432025-01-17T08:33:03.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 455 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 208cdebb-9304-42fe-b8b8-586511531786 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
28442025-01-17T08:33:04.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fdd47943-5fe0-4286-95f1-3bb658c1eaf6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28452025-01-17T08:33:04.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fdd47943-5fe0-4286-95f1-3bb658c1eaf6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28462025-01-17T08:33:04.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fdd47943-5fe0-4286-95f1-3bb658c1eaf6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28472025-01-17T08:33:05.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a6bf8b4c-0caa-4c91-9f9b-5b1276bdcc63 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28482025-01-17T08:33:05.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a6bf8b4c-0caa-4c91-9f9b-5b1276bdcc63 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28492025-01-17T08:33:05.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a6bf8b4c-0caa-4c91-9f9b-5b1276bdcc63 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28502025-01-17T08:33:06.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd520609-d423-4068-b288-c68eba8081e8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28512025-01-17T08:33:06.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd520609-d423-4068-b288-c68eba8081e8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28522025-01-17T08:33:06.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fd520609-d423-4068-b288-c68eba8081e8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28532025-01-17T08:33:07.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1cbc69bd-ae57-430f-8429-08f18f670849 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28542025-01-17T08:33:07.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1cbc69bd-ae57-430f-8429-08f18f670849 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28552025-01-17T08:33:07.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1cbc69bd-ae57-430f-8429-08f18f670849 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28562025-01-17T08:33:08.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fc51d2d-aa90-4857-8ad0-e173118a8526 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28572025-01-17T08:33:08.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fc51d2d-aa90-4857-8ad0-e173118a8526 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28582025-01-17T08:33:08.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2769 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fc51d2d-aa90-4857-8ad0-e173118a8526 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28592025-01-17T08:33:09.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4530d916-5a49-4c30-b254-804a97476d72 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28602025-01-17T08:33:09.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4530d916-5a49-4c30-b254-804a97476d72 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28612025-01-17T08:33:09.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4530d916-5a49-4c30-b254-804a97476d72 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28622025-01-17T08:33:10.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf204920-4630-4e91-b229-864104244e4f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28632025-01-17T08:33:10.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf204920-4630-4e91-b229-864104244e4f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28642025-01-17T08:33:10.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf204920-4630-4e91-b229-864104244e4f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28652025-01-17T08:33:11.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8a2ba8c7-5ccd-4ac6-a212-ec3ad59f71b7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28662025-01-17T08:33:11.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8a2ba8c7-5ccd-4ac6-a212-ec3ad59f71b7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28672025-01-17T08:33:11.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8a2ba8c7-5ccd-4ac6-a212-ec3ad59f71b7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28682025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
28692025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
28702025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28712025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
28722025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28732025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28742025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
28752025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
28762025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28772025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28782025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
28792025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
28802025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
28812025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28822025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28832025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
28842025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
28852025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28862025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28872025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
28882025-01-17T08:33:11.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28892025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28902025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28912025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28922025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28932025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28942025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28952025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28962025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28972025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28982025-01-17T08:33:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28992025-01-17T08:33:11.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29002025-01-17T08:33:11.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012025-01-17T08:33:11.887ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.095924ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29022025-01-17T08:33:11.888ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 63520270 } })
29032025-01-17T08:33:11.888ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 63597451 } })
29042025-01-17T08:33:11.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
29052025-01-17T08:33:11.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
29062025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29072025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29082025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29092025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29102025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
29112025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29122025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29132025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
29142025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
29152025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29162025-01-17T08:33:11.890ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29172025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29182025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29192025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29202025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29212025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29222025-01-17T08:33:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29232025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29242025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
29252025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
29262025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29272025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29282025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
29292025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29302025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
29312025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29322025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29332025-01-17T08:33:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29342025-01-17T08:33:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29352025-01-17T08:33:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29362025-01-17T08:33:11.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29372025-01-17T08:33:11.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29382025-01-17T08:33:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29392025-01-17T08:33:11.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29402025-01-17T08:33:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29412025-01-17T08:33:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29422025-01-17T08:33:11.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29432025-01-17T08:33:11.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29442025-01-17T08:33:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29452025-01-17T08:33:11.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29462025-01-17T08:33:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29472025-01-17T08:33:11.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29482025-01-17T08:33:11.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29492025-01-17T08:33:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29502025-01-17T08:33:11.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29512025-01-17T08:33:11.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29522025-01-17T08:33:11.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29532025-01-17T08:33:11.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29542025-01-17T08:33:11.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29552025-01-17T08:33:11.902ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1901, tv_nsec: 77456741 } })
29562025-01-17T08:33:11.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
29572025-01-17T08:33:11.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29582025-01-17T08:33:11.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29592025-01-17T08:33:11.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29602025-01-17T08:33:11.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29612025-01-17T08:33:11.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29622025-01-17T08:33:11.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29632025-01-17T08:33:11.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29642025-01-17T08:33:11.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29652025-01-17T08:33:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29662025-01-17T08:33:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29672025-01-17T08:33:11.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29682025-01-17T08:33:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29692025-01-17T08:33:11.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702025-01-17T08:33:11.934ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29712025-01-17T08:33:11.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722025-01-17T08:33:11.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29732025-01-17T08:33:11.935ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29742025-01-17T08:33:11.935ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29752025-01-17T08:33:11.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29762025-01-17T08:33:11.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772025-01-17T08:33:11.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29782025-01-17T08:33:11.936ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29792025-01-17T08:33:11.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29802025-01-17T08:33:11.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29812025-01-17T08:33:11.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29822025-01-17T08:33:11.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29832025-01-17T08:33:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29842025-01-17T08:33:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29852025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
29862025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29872025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29882025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
29892025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902025-01-17T08:33:11.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.308255ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
29912025-01-17T08:33:11.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29922025-01-17T08:33:11.940ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29932025-01-17T08:33:11.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.264928ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29942025-01-17T08:33:11.941ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29952025-01-17T08:33:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29962025-01-17T08:33:11.941ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29972025-01-17T08:33:11.941ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29982025-01-17T08:33:11.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29992025-01-17T08:33:11.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002025-01-17T08:33:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30012025-01-17T08:33:11.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.435562ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
30022025-01-17T08:33:11.943ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.775982ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30032025-01-17T08:33:11.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30042025-01-17T08:33:11.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30052025-01-17T08:33:11.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30062025-01-17T08:33:11.945ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.74905ms iteration = 20 status = 0
30072025-01-17T08:33:11.947ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30082025-01-17T08:33:11.947ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30092025-01-17T08:33:11.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 56.610288ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30102025-01-17T08:33:11.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.162747ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30112025-01-17T08:33:11.964ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
30122025-01-17T08:33:11.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.803581ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
30132025-01-17T08:33:11.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
30142025-01-17T08:33:11.968ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30152025-01-17T08:33:11.969ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63615fcd-2b5e-41e9-b07d-1a929b79daaf", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30162025-01-17T08:33:11.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30172025-01-17T08:33:11.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30182025-01-17T08:33:11.972ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192025-01-17T08:33:11.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.734093ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30202025-01-17T08:33:11.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30212025-01-17T08:33:11.974ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30222025-01-17T08:33:11.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30232025-01-17T08:33:11.978ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30242025-01-17T08:33:11.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30252025-01-17T08:33:11.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30262025-01-17T08:33:11.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30272025-01-17T08:33:12.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
30282025-01-17T08:33:12.003ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30292025-01-17T08:33:12.003ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ab93ad-c1cf-41e6-8a0e-e4752d066636", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30302025-01-17T08:33:12.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30312025-01-17T08:33:12.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30322025-01-17T08:33:12.005ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
30332025-01-17T08:33:12.005ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.525604ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30342025-01-17T08:33:12.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30352025-01-17T08:33:12.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30362025-01-17T08:33:12.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.844322ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30372025-01-17T08:33:12.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30382025-01-17T08:33:12.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30392025-01-17T08:33:12.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30402025-01-17T08:33:12.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30412025-01-17T08:33:12.045ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.46926ms iteration = 22 status = {"physical_disks_added":0}
30422025-01-17T08:33:12.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
30432025-01-17T08:33:12.063ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30442025-01-17T08:33:12.063ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2c44c4d-25f8-4406-b460-158cc3e84353", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30452025-01-17T08:33:12.063ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30462025-01-17T08:33:12.065ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
30472025-01-17T08:33:12.066ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30482025-01-17T08:33:12.066ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb7b6e16-7a48-4567-94e3-66169ba0770b", "content-length": "1", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30492025-01-17T08:33:12.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30502025-01-17T08:33:12.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30512025-01-17T08:33:12.113ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30522025-01-17T08:33:12.113ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30532025-01-17T08:33:12.113ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "732ff70c-dc81-4a2a-ad61-c26c1897f2ae", "content-length": "372", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30542025-01-17T08:33:12.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30552025-01-17T08:33:12.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30562025-01-17T08:33:12.116ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.625733ms iteration = 20 status = null
30572025-01-17T08:33:12.134ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.370324ms iteration = 20 status = {}
30582025-01-17T08:33:12.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592025-01-17T08:33:12.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30602025-01-17T08:33:12.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30612025-01-17T08:33:12.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30622025-01-17T08:33:12.164ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30632025-01-17T08:33:12.164ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30642025-01-17T08:33:12.164ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0758ff34-ba81-423b-bfff-0ff88e1ef6bf", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30652025-01-17T08:33:12.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30662025-01-17T08:33:12.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30672025-01-17T08:33:12.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30682025-01-17T08:33:12.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30692025-01-17T08:33:12.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30702025-01-17T08:33:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30712025-01-17T08:33:12.173ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30722025-01-17T08:33:12.173ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30732025-01-17T08:33:12.173ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2a0ce6c9-9782-4ed8-a98d-b3f376ad8bb5", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30742025-01-17T08:33:12.175ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 284.667233ms iteration = 20 status = {}
30752025-01-17T08:33:12.205ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30762025-01-17T08:33:12.205ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf0add86-0870-440a-a3f1-f20568cd57d4", "content-length": "691", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30772025-01-17T08:33:12.205ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30782025-01-17T08:33:12.205ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30792025-01-17T08:33:12.205ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30802025-01-17T08:33:12.207ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 322.459912ms iteration = 20 status = {}
30812025-01-17T08:33:12.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30822025-01-17T08:33:12.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30832025-01-17T08:33:12.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
30842025-01-17T08:33:12.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30852025-01-17T08:33:12.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30862025-01-17T08:33:12.250ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30872025-01-17T08:33:12.251ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d64ed651-37a5-4867-ba7e-d40cd8d512fe", "content-length": "134", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
30882025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30892025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
30902025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30912025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30922025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30932025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30942025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30952025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30962025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30972025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30982025-01-17T08:33:12.251ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
30992025-01-17T08:33:12.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31002025-01-17T08:33:12.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31012025-01-17T08:33:12.254ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31022025-01-17T08:33:12.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea47f257-6c12-4df9-b1af-49f1a40fcc01", "content-length": "2", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
31032025-01-17T08:33:12.254ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31042025-01-17T08:33:12.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5217236-4736-4996-a6a8-de9f3ec3a3a8", "content-length": "52", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
31052025-01-17T08:33:12.254ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
31062025-01-17T08:33:12.254ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31072025-01-17T08:33:12.345ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "528789d7-d3a9-42d0-adba-54dbe8d768df", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
31082025-01-17T08:33:12.345ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
31092025-01-17T08:33:12.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31102025-01-17T08:33:12.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a95738-e356-48fe-99b3-79c892faf879 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31112025-01-17T08:33:12.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a95738-e356-48fe-99b3-79c892faf879 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31122025-01-17T08:33:12.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f704d61-0951-4594-99e8-1db24ec5b68f", "content-length": "682", "date": "Fri, 17 Jan 2025 08:33:11 GMT"} })
31132025-01-17T08:33:12.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31142025-01-17T08:33:12.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31152025-01-17T08:33:12.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 78a95738-e356-48fe-99b3-79c892faf879 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31162025-01-17T08:33:12.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31172025-01-17T08:33:12.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31182025-01-17T08:33:12.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31192025-01-17T08:33:12.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31202025-01-17T08:33:12.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31212025-01-17T08:33:12.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31222025-01-17T08:33:12.361ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.916913ms iteration = 20 status = {}
31232025-01-17T08:33:12.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 48b4c336-a12f-4114-b670-3a7409f255f4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31242025-01-17T08:33:12.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 48b4c336-a12f-4114-b670-3a7409f255f4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31252025-01-17T08:33:12.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 48b4c336-a12f-4114-b670-3a7409f255f4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31262025-01-17T08:33:13.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d36f8de4-f26b-42db-9c4b-16c21071d238 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31272025-01-17T08:33:13.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d36f8de4-f26b-42db-9c4b-16c21071d238 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31282025-01-17T08:33:13.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d36f8de4-f26b-42db-9c4b-16c21071d238 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31292025-01-17T08:33:13.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 502 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = b53369ab-51f5-4f2d-a628-3e582fff4bfa response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
31302025-01-17T08:33:14.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5ac2a54-8cb2-4e3b-b439-4bac69642caa roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31312025-01-17T08:33:14.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5ac2a54-8cb2-4e3b-b439-4bac69642caa resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31322025-01-17T08:33:14.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5ac2a54-8cb2-4e3b-b439-4bac69642caa response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31332025-01-17T08:33:15.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 795368ca-406c-4b78-8a5c-bddf424aa4bb roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31342025-01-17T08:33:15.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 795368ca-406c-4b78-8a5c-bddf424aa4bb resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31352025-01-17T08:33:15.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 795368ca-406c-4b78-8a5c-bddf424aa4bb response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31362025-01-17T08:33:16.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6752ab9c-c953-4ed4-aac2-f3628d086e93 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31372025-01-17T08:33:16.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6752ab9c-c953-4ed4-aac2-f3628d086e93 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31382025-01-17T08:33:16.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6752ab9c-c953-4ed4-aac2-f3628d086e93 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31392025-01-17T08:33:17.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f024c32c-8d72-4560-b3a8-5e2802a1fa65 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31402025-01-17T08:33:17.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f024c32c-8d72-4560-b3a8-5e2802a1fa65 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31412025-01-17T08:33:17.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f024c32c-8d72-4560-b3a8-5e2802a1fa65 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31422025-01-17T08:33:18.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 62b117d3-88a4-43ae-bf7d-9a4ebb998264 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31432025-01-17T08:33:18.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 62b117d3-88a4-43ae-bf7d-9a4ebb998264 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31442025-01-17T08:33:18.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 62b117d3-88a4-43ae-bf7d-9a4ebb998264 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31452025-01-17T08:33:19.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6f59e538-2de6-44e9-a37c-81a870be44e5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31462025-01-17T08:33:19.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6f59e538-2de6-44e9-a37c-81a870be44e5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31472025-01-17T08:33:19.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6f59e538-2de6-44e9-a37c-81a870be44e5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31482025-01-17T08:33:20.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d0d0853-e94c-4019-91b7-bb87929c4296 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31492025-01-17T08:33:20.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d0d0853-e94c-4019-91b7-bb87929c4296 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31502025-01-17T08:33:20.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2295 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d0d0853-e94c-4019-91b7-bb87929c4296 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31512025-01-17T08:33:21.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b3f4d4b-7309-40de-9881-5cb8de65cf26 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31522025-01-17T08:33:21.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b3f4d4b-7309-40de-9881-5cb8de65cf26 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31532025-01-17T08:33:21.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8b3f4d4b-7309-40de-9881-5cb8de65cf26 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31542025-01-17T08:33:21.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
31552025-01-17T08:33:21.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31562025-01-17T08:33:21.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31572025-01-17T08:33:21.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
31582025-01-17T08:33:21.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31592025-01-17T08:33:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31602025-01-17T08:33:21.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612025-01-17T08:33:21.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31622025-01-17T08:33:21.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31632025-01-17T08:33:21.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31642025-01-17T08:33:21.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31652025-01-17T08:33:21.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31662025-01-17T08:33:21.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672025-01-17T08:33:21.918ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31682025-01-17T08:33:21.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31692025-01-17T08:33:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
31702025-01-17T08:33:21.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31712025-01-17T08:33:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31722025-01-17T08:33:21.931ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
31732025-01-17T08:33:21.932ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.669527ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
31742025-01-17T08:33:21.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.515059ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31752025-01-17T08:33:22.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de3f5ab3-0af4-4f17-95f2-2e105f2b1d05 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31762025-01-17T08:33:22.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de3f5ab3-0af4-4f17-95f2-2e105f2b1d05 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31772025-01-17T08:33:22.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = de3f5ab3-0af4-4f17-95f2-2e105f2b1d05 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31782025-01-17T08:33:23.488ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:59437
31792025-01-17T08:33:23.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 16fda8bb-eacc-47b1-bd9d-06bbfba91ad2 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
31802025-01-17T08:33:23.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 16fda8bb-eacc-47b1-bd9d-06bbfba91ad2 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
31812025-01-17T08:33:23.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2681 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 16fda8bb-eacc-47b1-bd9d-06bbfba91ad2 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
31822025-01-17T08:33:23.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = f30d364f-ed90-4e7a-8595-5b5ea35c8d85 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
31832025-01-17T08:33:23.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = f30d364f-ed90-4e7a-8595-5b5ea35c8d85 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
31842025-01-17T08:33:23.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = f30d364f-ed90-4e7a-8595-5b5ea35c8d85 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
31852025-01-17T08:33:23.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 485dc757-fe21-4d60-957e-9418f3048a7c response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
31862025-01-17T08:33:23.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ddfe8a29-e731-442d-ad66-c115cff664d5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31872025-01-17T08:33:23.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ddfe8a29-e731-442d-ad66-c115cff664d5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31882025-01-17T08:33:23.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ddfe8a29-e731-442d-ad66-c115cff664d5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31892025-01-17T08:33:24.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21147740-8e6d-4044-ba1b-3dd2e07bad39 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31902025-01-17T08:33:24.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21147740-8e6d-4044-ba1b-3dd2e07bad39 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31912025-01-17T08:33:24.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1813 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21147740-8e6d-4044-ba1b-3dd2e07bad39 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31922025-01-17T08:33:25.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 82ee757e-049d-47b1-9ffc-017a6578a60d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31932025-01-17T08:33:25.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 82ee757e-049d-47b1-9ffc-017a6578a60d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31942025-01-17T08:33:25.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 82ee757e-049d-47b1-9ffc-017a6578a60d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31952025-01-17T08:33:26.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2cab7d-e87a-4a8c-a32d-40222b2342c7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31962025-01-17T08:33:26.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2cab7d-e87a-4a8c-a32d-40222b2342c7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31972025-01-17T08:33:26.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2cab7d-e87a-4a8c-a32d-40222b2342c7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31982025-01-17T08:33:27.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f4798675-4812-4151-88c7-ff12a7d1252c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
31992025-01-17T08:33:27.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f4798675-4812-4151-88c7-ff12a7d1252c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32002025-01-17T08:33:27.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f4798675-4812-4151-88c7-ff12a7d1252c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32012025-01-17T08:33:28.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3063922d-b445-4e23-9520-b2aff0be9b09 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32022025-01-17T08:33:28.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3063922d-b445-4e23-9520-b2aff0be9b09 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32032025-01-17T08:33:28.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3063922d-b445-4e23-9520-b2aff0be9b09 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32042025-01-17T08:33:29.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4607fb5b-5bec-44a6-9599-752a7bfbce73 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32052025-01-17T08:33:29.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4607fb5b-5bec-44a6-9599-752a7bfbce73 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32062025-01-17T08:33:29.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4607fb5b-5bec-44a6-9599-752a7bfbce73 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32072025-01-17T08:33:30.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32735912-6ad0-4807-a699-a6c41093a321 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32082025-01-17T08:33:30.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32735912-6ad0-4807-a699-a6c41093a321 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32092025-01-17T08:33:30.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 32735912-6ad0-4807-a699-a6c41093a321 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32102025-01-17T08:33:31.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b7c8adac-12cd-442f-a7e7-a784993304ac roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32112025-01-17T08:33:31.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b7c8adac-12cd-442f-a7e7-a784993304ac resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32122025-01-17T08:33:31.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b7c8adac-12cd-442f-a7e7-a784993304ac response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32132025-01-17T08:33:31.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
32142025-01-17T08:33:31.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32152025-01-17T08:33:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32162025-01-17T08:33:31.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172025-01-17T08:33:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32182025-01-17T08:33:31.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32192025-01-17T08:33:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32202025-01-17T08:33:31.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
32212025-01-17T08:33:31.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32222025-01-17T08:33:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32232025-01-17T08:33:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32242025-01-17T08:33:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32252025-01-17T08:33:31.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32262025-01-17T08:33:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32272025-01-17T08:33:31.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.030794ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32282025-01-17T08:33:31.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292025-01-17T08:33:31.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
32302025-01-17T08:33:31.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32312025-01-17T08:33:31.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32322025-01-17T08:33:31.942ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
32332025-01-17T08:33:31.943ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.638344ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
32342025-01-17T08:33:32.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c01b8764-674a-4297-ab27-603a5c83d73a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32352025-01-17T08:33:32.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c01b8764-674a-4297-ab27-603a5c83d73a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32362025-01-17T08:33:32.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c01b8764-674a-4297-ab27-603a5c83d73a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32372025-01-17T08:33:33.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 472 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 16376020-2ea8-4d04-8e32-8108b4bcdff3 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
32382025-01-17T08:33:33.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42901bc-b29f-4858-9f74-dc791f39b6dd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32392025-01-17T08:33:33.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42901bc-b29f-4858-9f74-dc791f39b6dd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32402025-01-17T08:33:33.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42901bc-b29f-4858-9f74-dc791f39b6dd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32412025-01-17T08:33:34.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ee187c5f-cf34-44e8-81e4-e0d9eaaa2eb1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32422025-01-17T08:33:34.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ee187c5f-cf34-44e8-81e4-e0d9eaaa2eb1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32432025-01-17T08:33:34.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ee187c5f-cf34-44e8-81e4-e0d9eaaa2eb1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32442025-01-17T08:33:35.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 497ff757-849e-42a9-bad5-1cb10d25f23d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32452025-01-17T08:33:35.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 497ff757-849e-42a9-bad5-1cb10d25f23d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32462025-01-17T08:33:35.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2662 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 497ff757-849e-42a9-bad5-1cb10d25f23d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32472025-01-17T08:33:36.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f36746ae-ed31-4390-b732-f3063deaac1e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32482025-01-17T08:33:36.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f36746ae-ed31-4390-b732-f3063deaac1e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32492025-01-17T08:33:36.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f36746ae-ed31-4390-b732-f3063deaac1e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32502025-01-17T08:33:37.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5c7affd-5619-4511-ba69-1b3cd546dfd9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32512025-01-17T08:33:37.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5c7affd-5619-4511-ba69-1b3cd546dfd9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32522025-01-17T08:33:37.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5c7affd-5619-4511-ba69-1b3cd546dfd9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32532025-01-17T08:33:38.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 61091370-3c3c-4a5c-8007-98f1831b0c3d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32542025-01-17T08:33:38.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 61091370-3c3c-4a5c-8007-98f1831b0c3d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32552025-01-17T08:33:38.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 61091370-3c3c-4a5c-8007-98f1831b0c3d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32562025-01-17T08:33:39.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbb7d01a-c583-454a-859a-1a9dc5c57836 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32572025-01-17T08:33:39.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbb7d01a-c583-454a-859a-1a9dc5c57836 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32582025-01-17T08:33:39.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fbb7d01a-c583-454a-859a-1a9dc5c57836 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32592025-01-17T08:33:40.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 973c3e3a-71ea-45fa-a753-a6646c0ae667 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32602025-01-17T08:33:40.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 973c3e3a-71ea-45fa-a753-a6646c0ae667 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32612025-01-17T08:33:40.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 973c3e3a-71ea-45fa-a753-a6646c0ae667 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
32622025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
32632025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
32642025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32652025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32662025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
32672025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
32682025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32692025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32702025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
32712025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
32722025-01-17T08:33:41.883ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:23:41.883336588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32732025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32742025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
32752025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32762025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32772025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32782025-01-17T08:33:41.883ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 58222458 } })
32792025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
32802025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
32812025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
32822025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32832025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
32842025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32852025-01-17T08:33:41.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32862025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32872025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
32882025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
32892025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32902025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
32912025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32922025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
32932025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32942025-01-17T08:33:41.884ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 58425680 } })
32952025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
32962025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
32972025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32982025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
32992025-01-17T08:33:41.884ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33002025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33012025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33022025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33032025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
33042025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
33052025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33062025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33072025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
33082025-01-17T08:33:41.884ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
33092025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.8\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
33102025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
33112025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
33122025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33132025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33142025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33152025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
33162025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.134089ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
33172025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33182025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33192025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33202025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33212025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33222025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.22965ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33232025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33242025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33252025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33262025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33272025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
33282025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33292025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33302025-01-17T08:33:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33312025-01-17T08:33:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33322025-01-17T08:33:41.885ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
33332025-01-17T08:33:41.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33342025-01-17T08:33:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33352025-01-17T08:33:41.886ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:23:41.883336588 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33362025-01-17T08:33:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.735922ms iteration = 11 status = {"expiration":"2025-01-17T08:23:41.883336588Z","pruned":[]}
33372025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33382025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
33392025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33402025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
33412025-01-17T08:33:41.890ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33422025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33432025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33442025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
33452025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33462025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
33472025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33482025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33492025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33502025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33512025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33522025-01-17T08:33:41.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33532025-01-17T08:33:41.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 66214712 } })
33542025-01-17T08:33:41.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552025-01-17T08:33:41.892ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.160195ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33562025-01-17T08:33:41.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
33572025-01-17T08:33:41.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 66750516 } })
33582025-01-17T08:33:41.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
33592025-01-17T08:33:41.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33602025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33612025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33622025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
33632025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
33642025-01-17T08:33:41.893ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
33652025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33662025-01-17T08:33:41.893ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
33672025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
33682025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33692025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
33702025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33712025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
33722025-01-17T08:33:41.893ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
33732025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33742025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
33752025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33762025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
33772025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33782025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
33792025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33802025-01-17T08:33:41.893ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
33812025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33822025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33832025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33842025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33852025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33862025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33872025-01-17T08:33:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33882025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33892025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33902025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33912025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33932025-01-17T08:33:41.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33942025-01-17T08:33:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33952025-01-17T08:33:41.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33962025-01-17T08:33:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33972025-01-17T08:33:41.896ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33982025-01-17T08:33:41.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33992025-01-17T08:33:41.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002025-01-17T08:33:41.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012025-01-17T08:33:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34022025-01-17T08:33:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34032025-01-17T08:33:41.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34042025-01-17T08:33:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34052025-01-17T08:33:41.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34062025-01-17T08:33:41.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34072025-01-17T08:33:41.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
34082025-01-17T08:33:41.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34092025-01-17T08:33:41.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34102025-01-17T08:33:41.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112025-01-17T08:33:41.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122025-01-17T08:33:41.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34132025-01-17T08:33:41.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142025-01-17T08:33:41.904ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34152025-01-17T08:33:41.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34162025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34172025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34182025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34192025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34202025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34212025-01-17T08:33:41.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34222025-01-17T08:33:41.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34232025-01-17T08:33:41.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34242025-01-17T08:33:41.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34252025-01-17T08:33:41.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34262025-01-17T08:33:41.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34272025-01-17T08:33:41.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34282025-01-17T08:33:41.911ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.904842ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
34292025-01-17T08:33:41.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34302025-01-17T08:33:41.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34312025-01-17T08:33:41.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34322025-01-17T08:33:41.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34332025-01-17T08:33:41.916ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 90588045 } })
34342025-01-17T08:33:41.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
34352025-01-17T08:33:41.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34362025-01-17T08:33:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34372025-01-17T08:33:41.935ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34382025-01-17T08:33:41.938ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
34392025-01-17T08:33:41.939ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
34402025-01-17T08:33:41.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
34412025-01-17T08:33:41.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422025-01-17T08:33:41.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34432025-01-17T08:33:41.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34442025-01-17T08:33:41.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34452025-01-17T08:33:41.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34462025-01-17T08:33:41.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34472025-01-17T08:33:41.947ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34482025-01-17T08:33:41.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34492025-01-17T08:33:41.948ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502025-01-17T08:33:41.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.433749ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
34512025-01-17T08:33:41.949ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34522025-01-17T08:33:41.949ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34532025-01-17T08:33:41.949ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.941043ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34542025-01-17T08:33:41.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34552025-01-17T08:33:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34562025-01-17T08:33:41.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572025-01-17T08:33:41.951ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34582025-01-17T08:33:41.951ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34592025-01-17T08:33:41.951ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34602025-01-17T08:33:41.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34612025-01-17T08:33:41.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34622025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34632025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34642025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34652025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34662025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34672025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34682025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34692025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34702025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34712025-01-17T08:33:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34722025-01-17T08:33:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34732025-01-17T08:33:41.954ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34742025-01-17T08:33:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34752025-01-17T08:33:41.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34762025-01-17T08:33:41.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34772025-01-17T08:33:41.956ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
34782025-01-17T08:33:41.956ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 63.314241ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
34792025-01-17T08:33:41.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34802025-01-17T08:33:41.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 55bf6bfb-ca9f-425c-8c6e-8312b5c539b3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
34812025-01-17T08:33:41.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 55bf6bfb-ca9f-425c-8c6e-8312b5c539b3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
34822025-01-17T08:33:41.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832025-01-17T08:33:41.957ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34842025-01-17T08:33:41.957ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34852025-01-17T08:33:41.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34862025-01-17T08:33:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34872025-01-17T08:33:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
34882025-01-17T08:33:41.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34892025-01-17T08:33:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34902025-01-17T08:33:41.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34912025-01-17T08:33:41.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34922025-01-17T08:33:41.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.713678ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
34932025-01-17T08:33:41.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34942025-01-17T08:33:41.961ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34952025-01-17T08:33:41.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.922791ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34962025-01-17T08:33:41.963ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34972025-01-17T08:33:41.963ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34982025-01-17T08:33:41.963ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.074345ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34992025-01-17T08:33:41.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35002025-01-17T08:33:41.965ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(5200de2a-c041-4c37-963b-0c8656be7fa4, 0), (30a1347f-6b02-4315-b60b-71f9f444314b, 0), (cad98c52-abcf-47ab-b512-a8d7397e9b67, 0), (6323a15a-7bfc-44f1-9b45-6a822deb5c8c, 0)] collection_id = 5200de2a-c041-4c37-963b-0c8656be7fa4
35012025-01-17T08:33:41.965ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
35022025-01-17T08:33:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35032025-01-17T08:33:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
35042025-01-17T08:33:41.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.781656ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35052025-01-17T08:33:41.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35062025-01-17T08:33:41.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35072025-01-17T08:33:41.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35082025-01-17T08:33:41.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35092025-01-17T08:33:41.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.954893ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35102025-01-17T08:33:42.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35112025-01-17T08:33:42.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35122025-01-17T08:33:42.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35132025-01-17T08:33:42.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
35142025-01-17T08:33:42.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35152025-01-17T08:33:42.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "327ab60a-a984-42c1-af90-58d0a6af677e", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
35162025-01-17T08:33:42.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35172025-01-17T08:33:42.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35182025-01-17T08:33:42.176ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35192025-01-17T08:33:42.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
35202025-01-17T08:33:42.204ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35212025-01-17T08:33:42.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e970bdb-6639-4cec-905d-e10a6cc5de17", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
35222025-01-17T08:33:42.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35232025-01-17T08:33:42.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35242025-01-17T08:33:42.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
35252025-01-17T08:33:42.230ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35262025-01-17T08:33:42.230ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28f8cc56-8e0a-497f-a91b-a85bd5d9bc76", "content-length": "26", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
35272025-01-17T08:33:42.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35282025-01-17T08:33:42.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
35292025-01-17T08:33:42.308ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35302025-01-17T08:33:42.308ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35312025-01-17T08:33:42.308ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bfdc725-ec57-4ed7-ab0c-9ec709f7f028", "content-length": "372", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
35322025-01-17T08:33:42.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35332025-01-17T08:33:42.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35342025-01-17T08:33:42.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35352025-01-17T08:33:42.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35362025-01-17T08:33:42.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35372025-01-17T08:33:42.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35382025-01-17T08:33:42.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392025-01-17T08:33:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35402025-01-17T08:33:42.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35412025-01-17T08:33:42.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35422025-01-17T08:33:42.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 361818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 55bf6bfb-ca9f-425c-8c6e-8312b5c539b3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
35432025-01-17T08:33:42.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
35442025-01-17T08:33:42.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 448.299667ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
35452025-01-17T08:33:42.340ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.983218ms iteration = 21 status = {}
35462025-01-17T08:33:42.340ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35472025-01-17T08:33:42.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "34de4e2b-596d-4845-b8dd-924f174672e2", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35482025-01-17T08:33:42.340ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35492025-01-17T08:33:42.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "22f3b690-b21c-41f5-84d6-aa0d74688259", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35502025-01-17T08:33:42.343ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35512025-01-17T08:33:42.345ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35522025-01-17T08:33:42.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 461.662603ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35532025-01-17T08:33:42.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35542025-01-17T08:33:42.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35552025-01-17T08:33:42.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35562025-01-17T08:33:42.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35572025-01-17T08:33:42.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35582025-01-17T08:33:42.349ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35592025-01-17T08:33:42.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35602025-01-17T08:33:42.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35612025-01-17T08:33:42.350ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35622025-01-17T08:33:42.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35632025-01-17T08:33:42.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642025-01-17T08:33:42.352ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35652025-01-17T08:33:42.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35662025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35672025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35682025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35692025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35702025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35712025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35722025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35732025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35742025-01-17T08:33:42.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35752025-01-17T08:33:42.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
35762025-01-17T08:33:42.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
35772025-01-17T08:33:42.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
35782025-01-17T08:33:42.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792025-01-17T08:33:42.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802025-01-17T08:33:42.361ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35812025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35822025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35832025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35842025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35852025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35862025-01-17T08:33:42.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35872025-01-17T08:33:42.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 469.219213ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35882025-01-17T08:33:42.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892025-01-17T08:33:42.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35902025-01-17T08:33:42.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35912025-01-17T08:33:42.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35922025-01-17T08:33:42.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35932025-01-17T08:33:42.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35942025-01-17T08:33:42.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35952025-01-17T08:33:42.368ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35962025-01-17T08:33:42.368ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35972025-01-17T08:33:42.368ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
35982025-01-17T08:33:42.368ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 484.847717ms iteration = 11 status = {"generation":1}
35992025-01-17T08:33:42.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36002025-01-17T08:33:42.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36012025-01-17T08:33:42.372ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36022025-01-17T08:33:42.372ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36032025-01-17T08:33:42.372ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de483bae-5383-471c-92ee-e1ca58c425d8", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
36042025-01-17T08:33:42.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36052025-01-17T08:33:42.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36062025-01-17T08:33:42.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36072025-01-17T08:33:42.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36082025-01-17T08:33:42.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36092025-01-17T08:33:42.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102025-01-17T08:33:42.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36112025-01-17T08:33:42.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36122025-01-17T08:33:42.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36132025-01-17T08:33:42.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36142025-01-17T08:33:42.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36152025-01-17T08:33:42.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36162025-01-17T08:33:42.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36172025-01-17T08:33:42.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36182025-01-17T08:33:42.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36192025-01-17T08:33:42.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36202025-01-17T08:33:42.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 498.214642ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36212025-01-17T08:33:42.391ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 5200de2a-c041-4c37-963b-0c8656be7fa4 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
36222025-01-17T08:33:42.391ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
36232025-01-17T08:33:42.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
36242025-01-17T08:33:42.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252025-01-17T08:33:42.395ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36262025-01-17T08:33:42.395ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36272025-01-17T08:33:42.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36282025-01-17T08:33:42.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36292025-01-17T08:33:42.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36302025-01-17T08:33:42.396ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "adb96856-2fda-46b6-8b5e-29d1dd3f7f03", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
36312025-01-17T08:33:42.397ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.526346ms iteration = 21 status = {}
36322025-01-17T08:33:42.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36332025-01-17T08:33:42.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36342025-01-17T08:33:42.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36352025-01-17T08:33:42.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36362025-01-17T08:33:42.403ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(30a1347f-6b02-4315-b60b-71f9f444314b, 0), (cad98c52-abcf-47ab-b512-a8d7397e9b67, 0), (6323a15a-7bfc-44f1-9b45-6a822deb5c8c, 0)]
36372025-01-17T08:33:42.403ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1931, tv_nsec: 578017381 } })
36382025-01-17T08:33:42.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36392025-01-17T08:33:42.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36402025-01-17T08:33:42.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412025-01-17T08:33:42.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36422025-01-17T08:33:42.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36432025-01-17T08:33:42.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
36442025-01-17T08:33:42.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36452025-01-17T08:33:42.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36462025-01-17T08:33:42.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36472025-01-17T08:33:42.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36482025-01-17T08:33:42.408ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
36492025-01-17T08:33:42.408ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 524.58411ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36502025-01-17T08:33:42.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512025-01-17T08:33:42.409ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 525.226265ms iteration = 21 status = 0
36522025-01-17T08:33:42.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36532025-01-17T08:33:42.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36542025-01-17T08:33:42.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36552025-01-17T08:33:42.411ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36562025-01-17T08:33:42.411ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36572025-01-17T08:33:42.411ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 521.471166ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36582025-01-17T08:33:42.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36592025-01-17T08:33:42.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 529.164627ms iteration = 5 status = {}
36602025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36612025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36622025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36632025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36642025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
36652025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36662025-01-17T08:33:42.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36672025-01-17T08:33:42.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682025-01-17T08:33:42.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36692025-01-17T08:33:42.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36702025-01-17T08:33:42.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36712025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
36722025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 536.072912ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36732025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
36742025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36752025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
36762025-01-17T08:33:42.420ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 537.624594ms iteration = 11 status = {"generation":2}
36772025-01-17T08:33:42.436ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 552.31245ms iteration = 23 status = {"physical_disks_added":0}
36782025-01-17T08:33:42.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36792025-01-17T08:33:42.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36802025-01-17T08:33:42.443ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36812025-01-17T08:33:42.443ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 553.147797ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36822025-01-17T08:33:42.445ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36832025-01-17T08:33:42.445ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "57da99e6-ba76-4d03-bde8-427dc9df1605", "content-length": "1", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
36842025-01-17T08:33:42.447ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36852025-01-17T08:33:42.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36862025-01-17T08:33:42.450ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 566.405502ms iteration = 21 status = null
36872025-01-17T08:33:42.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882025-01-17T08:33:42.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
36892025-01-17T08:33:42.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36902025-01-17T08:33:42.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36912025-01-17T08:33:42.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36922025-01-17T08:33:42.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36932025-01-17T08:33:42.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36942025-01-17T08:33:42.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36952025-01-17T08:33:42.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36962025-01-17T08:33:42.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36972025-01-17T08:33:42.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36982025-01-17T08:33:42.484ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "58a00dc7-ff32-4766-a8e4-4ff5d4701b6f", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36992025-01-17T08:33:42.484ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37002025-01-17T08:33:42.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37012025-01-17T08:33:42.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37022025-01-17T08:33:42.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37032025-01-17T08:33:42.486ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2389568c-b0ae-4b23-8160-70261ca8d629", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37042025-01-17T08:33:42.486ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37052025-01-17T08:33:42.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37062025-01-17T08:33:42.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "21e9e1e3-7f9b-4d8e-85e1-903bb0af5b71", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37072025-01-17T08:33:42.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37082025-01-17T08:33:42.490ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37092025-01-17T08:33:42.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 606.770841ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37102025-01-17T08:33:42.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f4479-3045-492c-bc18-54f67e9f6bf3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37112025-01-17T08:33:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f4479-3045-492c-bc18-54f67e9f6bf3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37122025-01-17T08:33:42.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f4479-3045-492c-bc18-54f67e9f6bf3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37132025-01-17T08:33:42.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37142025-01-17T08:33:42.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37152025-01-17T08:33:42.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37162025-01-17T08:33:42.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
37172025-01-17T08:33:42.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37182025-01-17T08:33:42.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37192025-01-17T08:33:42.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37202025-01-17T08:33:42.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37212025-01-17T08:33:42.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37222025-01-17T08:33:42.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37232025-01-17T08:33:42.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242025-01-17T08:33:42.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
37252025-01-17T08:33:42.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37262025-01-17T08:33:42.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37272025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
37282025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
37292025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
37302025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a480a81-91df-4af3-892d-d0d573836ecd", "content-length": "476", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37312025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
37322025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "caad83cc-9c92-4e4c-993d-d5367768bcc8", "content-length": "734", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37332025-01-17T08:33:42.530ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
37342025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f030a22-9d97-45e8-b009-3aa9204b60e9", "content-length": "111", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37352025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
37362025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "502e38a4-7278-459d-9f24-8bebc4f8c794", "content-length": "111", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37372025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
37382025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe9e548-09fc-4155-a789-6f6c1cce14e3", "content-length": "167", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37392025-01-17T08:33:42.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
37402025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "252b93ca-5402-4061-bd5f-e902513f0379", "content-length": "167", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37412025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
37422025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd9d52a6-229d-4b8b-b43a-fc399b7a4eaf", "content-length": "175", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37432025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
37442025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab4cf81c-5cfc-4ddc-a474-e239ddfe05e6", "content-length": "175", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37452025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
37462025-01-17T08:33:42.532ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf0a0ab-5504-4066-99d4-fcdcf9f4b886", "content-length": "702", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37472025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
37482025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae354a6d-6991-448e-ac75-d03199cea121", "content-length": "727", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37492025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
37502025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3191e01-cb08-4619-8cdd-dc39c9fb643c", "content-length": "729", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37512025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
37522025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "162e0e6b-fc72-473d-97d1-516732f8720c", "content-length": "728", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37532025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
37542025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "242dc815-a37e-41dd-a2b5-0a89b41439cb", "content-length": "722", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37552025-01-17T08:33:42.533ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
37562025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "624fc146-b753-4488-9671-228caf9f2888", "content-length": "109", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37572025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
37582025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "622413a2-e93d-48a6-bb9a-df25859a2ff3", "content-length": "109", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37592025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
37602025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6443e817-b023-45e2-a314-af570a5ef824", "content-length": "169", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37612025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
37622025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f83f18ba-c134-4476-8f22-d3bfe78e9cdc", "content-length": "169", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37632025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
37642025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d10332b-9f57-41dd-bf6d-7da54a0a20a6", "content-length": "178", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37652025-01-17T08:33:42.534ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
37662025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e15735e6-7cd6-4152-98fa-bf3cf859e2b8", "content-length": "178", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37672025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
37682025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fefbf656-55ea-47fb-a225-7aa0eb263e57", "content-length": "702", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37692025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37702025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "43897090-b770-4aeb-8b1c-f7cab41a1cbc", "content-length": "727", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37712025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37722025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "98f7355d-b0b7-454d-87b4-2c37668d09fb", "content-length": "729", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37732025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
37742025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e4d99c9-b812-426d-ac9e-207a30193079", "content-length": "728", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
37752025-01-17T08:33:42.535ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37762025-01-17T08:33:42.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37772025-01-17T08:33:42.556ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37782025-01-17T08:33:42.556ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d2fb2d5-d52d-4973-a8bc-9d7d8a89f67b", "content-length": "691", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
37792025-01-17T08:33:42.556ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37802025-01-17T08:33:42.556ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37812025-01-17T08:33:42.556ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37822025-01-17T08:33:42.557ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 673.232517ms iteration = 21 status = {}
37832025-01-17T08:33:42.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842025-01-17T08:33:42.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
37852025-01-17T08:33:42.559ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
37862025-01-17T08:33:42.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
37872025-01-17T08:33:42.568ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37882025-01-17T08:33:42.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37892025-01-17T08:33:42.570ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37902025-01-17T08:33:42.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37912025-01-17T08:33:42.572ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37922025-01-17T08:33:42.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37932025-01-17T08:33:42.574ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37942025-01-17T08:33:42.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37952025-01-17T08:33:42.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37962025-01-17T08:33:42.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37972025-01-17T08:33:42.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37982025-01-17T08:33:42.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37992025-01-17T08:33:42.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38002025-01-17T08:33:42.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38012025-01-17T08:33:42.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38022025-01-17T08:33:42.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38032025-01-17T08:33:42.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042025-01-17T08:33:42.581ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
38052025-01-17T08:33:42.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38062025-01-17T08:33:42.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38072025-01-17T08:33:42.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
38082025-01-17T08:33:42.584ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38092025-01-17T08:33:42.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38102025-01-17T08:33:42.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38112025-01-17T08:33:42.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38122025-01-17T08:33:42.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38132025-01-17T08:33:42.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38142025-01-17T08:33:42.588ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38152025-01-17T08:33:42.588ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38162025-01-17T08:33:42.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
38172025-01-17T08:33:42.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38182025-01-17T08:33:42.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38192025-01-17T08:33:42.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38202025-01-17T08:33:42.591ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cd75630-2922-4223-9dae-061d8e2e02fa", "content-length": "134", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
38212025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38222025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
38232025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38242025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38252025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38262025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38272025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38282025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38292025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38302025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38312025-01-17T08:33:42.591ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
38322025-01-17T08:33:42.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38332025-01-17T08:33:42.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38342025-01-17T08:33:42.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
38352025-01-17T08:33:42.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38362025-01-17T08:33:42.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38372025-01-17T08:33:42.594ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38382025-01-17T08:33:42.594ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a8ab5b6-c11c-41bc-933e-6b815d263b68", "content-length": "2", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
38392025-01-17T08:33:42.594ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38402025-01-17T08:33:42.594ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "202d058a-cc7e-4a7a-9b2b-f63ec516b573", "content-length": "52", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
38412025-01-17T08:33:42.594ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
38422025-01-17T08:33:42.594ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38432025-01-17T08:33:42.598ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
38442025-01-17T08:33:42.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38452025-01-17T08:33:42.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38462025-01-17T08:33:42.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38472025-01-17T08:33:42.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
38482025-01-17T08:33:42.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38492025-01-17T08:33:42.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38502025-01-17T08:33:42.603ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
38512025-01-17T08:33:42.603ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
38522025-01-17T08:33:42.603ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
38532025-01-17T08:33:42.678ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
38542025-01-17T08:33:42.678ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
38552025-01-17T08:33:42.687ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "af890880-f448-45d3-90c9-4b0eb44da736", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
38562025-01-17T08:33:42.687ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
38572025-01-17T08:33:42.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38582025-01-17T08:33:42.687ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf0a5ff0-dd86-4060-82f1-44e25c06f12d", "content-length": "682", "date": "Fri, 17 Jan 2025 08:33:41 GMT"} })
38592025-01-17T08:33:42.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38602025-01-17T08:33:42.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38612025-01-17T08:33:42.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38622025-01-17T08:33:42.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38632025-01-17T08:33:42.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38642025-01-17T08:33:42.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38652025-01-17T08:33:42.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38662025-01-17T08:33:42.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38672025-01-17T08:33:42.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.715163ms iteration = 21 status = {}
38682025-01-17T08:33:42.716ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, time_created: 2025-01-17T08:23:51.044803Z, time_modified: 2025-01-17T08:23:51.044803Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
38692025-01-17T08:33:42.716ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
38702025-01-17T08:33:42.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38712025-01-17T08:33:42.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38722025-01-17T08:33:42.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38732025-01-17T08:33:42.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38742025-01-17T08:33:42.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752025-01-17T08:33:42.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
38762025-01-17T08:33:42.754ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
38772025-01-17T08:33:42.755ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "2f8d6a24-c89a-4d1b-bc9e-9b00400d1c2d", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
38782025-01-17T08:33:42.757ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
38792025-01-17T08:33:42.757ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 864.407249ms
38802025-01-17T08:33:42.757ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 864.415899ms iteration = 3 status = {}
38812025-01-17T08:33:42.881ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b678588a-0756-43c5-a7f4-2466f341f807", "content-length": "30799", "date": "Fri, 17 Jan 2025 08:33:42 GMT"} })
38822025-01-17T08:33:42.883ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
38832025-01-17T08:33:42.883ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
38842025-01-17T08:33:42.883ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
38852025-01-17T08:33:42.885ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38862025-01-17T08:33:42.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38872025-01-17T08:33:42.887ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882025-01-17T08:33:42.888ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
38892025-01-17T08:33:42.888ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38902025-01-17T08:33:42.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
38912025-01-17T08:33:43.063ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d59fcee8-fc27-45b0-a260-5565cf11c9da file = nexus/db-queries/src/db/datastore/inventory.rs:1010
38922025-01-17T08:33:43.063ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d59fcee8-fc27-45b0-a260-5565cf11c9da time_started = 2025-01-17 08:33:42.530074 UTC
38932025-01-17T08:33:43.063ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.179821654s iteration = 3 status = {"collection_id":"d59fcee8-fc27-45b0-a260-5565cf11c9da","time_done":"2025-01-17 08:33:42.883535 UTC","time_started":"2025-01-17 08:33:42.530074 UTC"}
38942025-01-17T08:33:43.063ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
38952025-01-17T08:33:43.063ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
38962025-01-17T08:33:43.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38972025-01-17T08:33:43.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38982025-01-17T08:33:43.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38992025-01-17T08:33:43.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39002025-01-17T08:33:43.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012025-01-17T08:33:43.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022025-01-17T08:33:43.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39032025-01-17T08:33:43.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39042025-01-17T08:33:43.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39052025-01-17T08:33:43.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
39062025-01-17T08:33:43.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39072025-01-17T08:33:43.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39082025-01-17T08:33:43.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39092025-01-17T08:33:43.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39102025-01-17T08:33:43.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39112025-01-17T08:33:43.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39122025-01-17T08:33:43.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132025-01-17T08:33:43.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39142025-01-17T08:33:43.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39152025-01-17T08:33:43.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39162025-01-17T08:33:43.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39172025-01-17T08:33:43.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39182025-01-17T08:33:43.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192025-01-17T08:33:43.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39202025-01-17T08:33:43.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39212025-01-17T08:33:43.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39222025-01-17T08:33:43.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232025-01-17T08:33:43.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
39242025-01-17T08:33:43.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39252025-01-17T08:33:43.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39262025-01-17T08:33:43.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 43.802676ms iteration = 6 status = {}
39272025-01-17T08:33:43.110ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.395087ms iteration = 24 status = {"physical_disks_added":0}
39282025-01-17T08:33:43.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dd6932e-43a9-4b78-b520-74115c1f4044 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39292025-01-17T08:33:43.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dd6932e-43a9-4b78-b520-74115c1f4044 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39302025-01-17T08:33:43.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3dd6932e-43a9-4b78-b520-74115c1f4044 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39312025-01-17T08:33:43.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 502 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 734b4047-5951-490d-a10c-039babcb7203 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
39322025-01-17T08:33:44.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5b0f25c7-0431-4d74-9e80-47926f6beb05 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39332025-01-17T08:33:44.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5b0f25c7-0431-4d74-9e80-47926f6beb05 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39342025-01-17T08:33:44.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5b0f25c7-0431-4d74-9e80-47926f6beb05 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39352025-01-17T08:33:45.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca7b6f2f-f9c9-4492-aec7-ccf657043e55 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39362025-01-17T08:33:45.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca7b6f2f-f9c9-4492-aec7-ccf657043e55 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39372025-01-17T08:33:45.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca7b6f2f-f9c9-4492-aec7-ccf657043e55 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39382025-01-17T08:33:46.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 72cc0002-88c1-42d2-b48c-f329d6aa9be4 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39392025-01-17T08:33:46.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 72cc0002-88c1-42d2-b48c-f329d6aa9be4 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39402025-01-17T08:33:46.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 72cc0002-88c1-42d2-b48c-f329d6aa9be4 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39412025-01-17T08:33:47.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4469e6d4-c64e-4c00-a94e-25bd0ca65f3e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39422025-01-17T08:33:47.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4469e6d4-c64e-4c00-a94e-25bd0ca65f3e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39432025-01-17T08:33:47.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4469e6d4-c64e-4c00-a94e-25bd0ca65f3e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39442025-01-17T08:33:48.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92996db3-3133-4207-92b6-1971f17756ff roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39452025-01-17T08:33:48.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92996db3-3133-4207-92b6-1971f17756ff resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39462025-01-17T08:33:48.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 92996db3-3133-4207-92b6-1971f17756ff response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39472025-01-17T08:33:49.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 851c7783-faca-4919-b877-d707e6b3377d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39482025-01-17T08:33:49.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 851c7783-faca-4919-b877-d707e6b3377d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39492025-01-17T08:33:49.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 851c7783-faca-4919-b877-d707e6b3377d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39502025-01-17T08:33:50.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87e5c6e8-bab0-41d6-877c-986f5282dfe9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39512025-01-17T08:33:50.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87e5c6e8-bab0-41d6-877c-986f5282dfe9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39522025-01-17T08:33:50.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87e5c6e8-bab0-41d6-877c-986f5282dfe9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39532025-01-17T08:33:51.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1996bccc-9b6c-4f58-86b9-e9ca1251b057 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39542025-01-17T08:33:51.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1996bccc-9b6c-4f58-86b9-e9ca1251b057 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39552025-01-17T08:33:51.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1996bccc-9b6c-4f58-86b9-e9ca1251b057 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39562025-01-17T08:33:51.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
39572025-01-17T08:33:51.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39582025-01-17T08:33:51.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39592025-01-17T08:33:51.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602025-01-17T08:33:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39612025-01-17T08:33:51.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39622025-01-17T08:33:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39632025-01-17T08:33:51.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
39642025-01-17T08:33:51.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39652025-01-17T08:33:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39662025-01-17T08:33:51.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39672025-01-17T08:33:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39682025-01-17T08:33:51.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692025-01-17T08:33:51.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
39702025-01-17T08:33:51.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39712025-01-17T08:33:51.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39722025-01-17T08:33:51.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
39732025-01-17T08:33:51.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.951393ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
39742025-01-17T08:33:51.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39752025-01-17T08:33:51.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39762025-01-17T08:33:51.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.96598ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39772025-01-17T08:33:52.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f6a887f1-ecca-42e3-b15e-8a3411d7db05 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39782025-01-17T08:33:52.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f6a887f1-ecca-42e3-b15e-8a3411d7db05 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39792025-01-17T08:33:52.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f6a887f1-ecca-42e3-b15e-8a3411d7db05 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39802025-01-17T08:33:53.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 608 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 83cc7a21-8f90-4025-bab2-e76af387a20f response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
39812025-01-17T08:33:53.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fabad2d-44e4-4edc-b1ab-5a34720f6fdc roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39822025-01-17T08:33:53.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fabad2d-44e4-4edc-b1ab-5a34720f6fdc resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39832025-01-17T08:33:53.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1fabad2d-44e4-4edc-b1ab-5a34720f6fdc response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39842025-01-17T08:33:54.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e51d2a7-7e22-40f2-8a91-3d6d2a54b57c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39852025-01-17T08:33:54.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e51d2a7-7e22-40f2-8a91-3d6d2a54b57c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39862025-01-17T08:33:54.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9e51d2a7-7e22-40f2-8a91-3d6d2a54b57c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39872025-01-17T08:33:55.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4631ed4f-3a3e-4a4f-a85b-1ebe118c6599 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39882025-01-17T08:33:55.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4631ed4f-3a3e-4a4f-a85b-1ebe118c6599 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39892025-01-17T08:33:55.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4631ed4f-3a3e-4a4f-a85b-1ebe118c6599 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39902025-01-17T08:33:56.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df339251-49d0-4fd5-a516-f5f82d3d5b0f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39912025-01-17T08:33:56.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df339251-49d0-4fd5-a516-f5f82d3d5b0f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39922025-01-17T08:33:56.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df339251-49d0-4fd5-a516-f5f82d3d5b0f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39932025-01-17T08:33:57.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bee071ef-e5cd-40f7-ad07-9b7bb5badb96 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39942025-01-17T08:33:57.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bee071ef-e5cd-40f7-ad07-9b7bb5badb96 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39952025-01-17T08:33:57.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bee071ef-e5cd-40f7-ad07-9b7bb5badb96 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39962025-01-17T08:33:58.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c44f1c93-5ab8-4179-949a-96705f0a7595 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39972025-01-17T08:33:58.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c44f1c93-5ab8-4179-949a-96705f0a7595 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39982025-01-17T08:33:58.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c44f1c93-5ab8-4179-949a-96705f0a7595 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
39992025-01-17T08:33:59.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27499ef0-e4d0-4553-b01e-59054148dca9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40002025-01-17T08:33:59.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27499ef0-e4d0-4553-b01e-59054148dca9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40012025-01-17T08:33:59.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2831 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27499ef0-e4d0-4553-b01e-59054148dca9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40022025-01-17T08:34:00.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ecbd24fc-b62e-4b66-8c35-6a9391f35fa6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40032025-01-17T08:34:00.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ecbd24fc-b62e-4b66-8c35-6a9391f35fa6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40042025-01-17T08:34:00.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ecbd24fc-b62e-4b66-8c35-6a9391f35fa6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40052025-01-17T08:34:01.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6abcf10-6e40-4f2e-8947-d8a1d64fab84 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40062025-01-17T08:34:01.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6abcf10-6e40-4f2e-8947-d8a1d64fab84 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40072025-01-17T08:34:01.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e6abcf10-6e40-4f2e-8947-d8a1d64fab84 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40082025-01-17T08:34:01.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
40092025-01-17T08:34:01.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40102025-01-17T08:34:01.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40112025-01-17T08:34:01.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122025-01-17T08:34:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40132025-01-17T08:34:01.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40142025-01-17T08:34:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40152025-01-17T08:34:01.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
40162025-01-17T08:34:01.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40172025-01-17T08:34:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40182025-01-17T08:34:01.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192025-01-17T08:34:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202025-01-17T08:34:01.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212025-01-17T08:34:01.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
40222025-01-17T08:34:01.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40232025-01-17T08:34:01.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40242025-01-17T08:34:01.907ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
40252025-01-17T08:34:01.907ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.201304ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
40262025-01-17T08:34:01.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40272025-01-17T08:34:01.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40282025-01-17T08:34:01.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.850547ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40292025-01-17T08:34:02.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6a51e63d-060c-4059-a5a0-095a7142bd60 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40302025-01-17T08:34:02.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6a51e63d-060c-4059-a5a0-095a7142bd60 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40312025-01-17T08:34:02.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6a51e63d-060c-4059-a5a0-095a7142bd60 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40322025-01-17T08:34:03.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 462 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 39db4bc6-bc14-484a-bd4c-a8a518041684 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
40332025-01-17T08:34:03.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = db5af15c-b5f5-41cc-8d8e-6c0e29ca95fa roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40342025-01-17T08:34:03.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = db5af15c-b5f5-41cc-8d8e-6c0e29ca95fa resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40352025-01-17T08:34:03.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = db5af15c-b5f5-41cc-8d8e-6c0e29ca95fa response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40362025-01-17T08:34:04.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5876ad2-9402-4557-91c5-7552c8ea1e36 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40372025-01-17T08:34:04.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5876ad2-9402-4557-91c5-7552c8ea1e36 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40382025-01-17T08:34:04.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5876ad2-9402-4557-91c5-7552c8ea1e36 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40392025-01-17T08:34:05.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b222f602-c267-45d2-b359-a230aecc6b09 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40402025-01-17T08:34:05.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b222f602-c267-45d2-b359-a230aecc6b09 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40412025-01-17T08:34:05.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b222f602-c267-45d2-b359-a230aecc6b09 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40422025-01-17T08:34:06.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0589164-529f-4400-8355-a07cb33fab3b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40432025-01-17T08:34:06.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0589164-529f-4400-8355-a07cb33fab3b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40442025-01-17T08:34:06.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c0589164-529f-4400-8355-a07cb33fab3b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40452025-01-17T08:34:07.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dd6e1b5-0e77-44e5-9dca-511cb84d9022 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40462025-01-17T08:34:07.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dd6e1b5-0e77-44e5-9dca-511cb84d9022 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40472025-01-17T08:34:07.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dd6e1b5-0e77-44e5-9dca-511cb84d9022 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40482025-01-17T08:34:08.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0db573b-1dc0-4c68-a438-a765e7735b6f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40492025-01-17T08:34:08.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0db573b-1dc0-4c68-a438-a765e7735b6f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40502025-01-17T08:34:08.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2645 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0db573b-1dc0-4c68-a438-a765e7735b6f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40512025-01-17T08:34:09.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 822d2ebe-4300-49e7-b1e4-2d143cf1b50f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40522025-01-17T08:34:09.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 822d2ebe-4300-49e7-b1e4-2d143cf1b50f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40532025-01-17T08:34:09.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 822d2ebe-4300-49e7-b1e4-2d143cf1b50f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40542025-01-17T08:34:10.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba5eb40e-c1d8-4914-8ddf-2d43b71c21f5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40552025-01-17T08:34:10.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba5eb40e-c1d8-4914-8ddf-2d43b71c21f5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40562025-01-17T08:34:10.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2338 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ba5eb40e-c1d8-4914-8ddf-2d43b71c21f5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
40572025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
40582025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
40592025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40602025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40612025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
40622025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
40632025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40642025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
40652025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
40662025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
40672025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40682025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40692025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40702025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
40712025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40722025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
40732025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
40742025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40752025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40762025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
40772025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40782025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40792025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40802025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40812025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40822025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40832025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40842025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40852025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40862025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40872025-01-17T08:34:11.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40882025-01-17T08:34:11.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892025-01-17T08:34:11.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902025-01-17T08:34:11.888ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.067684ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40912025-01-17T08:34:11.888ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 62814365 } })
40922025-01-17T08:34:11.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
40932025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40942025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40952025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40962025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40972025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40982025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
40992025-01-17T08:34:11.890ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41002025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41012025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
41022025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41032025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
41042025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41052025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41062025-01-17T08:34:11.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41072025-01-17T08:34:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41082025-01-17T08:34:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41092025-01-17T08:34:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41102025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41112025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
41132025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
41142025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41152025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41162025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
41172025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41182025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
41192025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41202025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41212025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41222025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41232025-01-17T08:34:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41242025-01-17T08:34:11.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41252025-01-17T08:34:11.894ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 68595211 } })
41262025-01-17T08:34:11.894ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
41272025-01-17T08:34:11.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41282025-01-17T08:34:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41292025-01-17T08:34:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41302025-01-17T08:34:11.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41312025-01-17T08:34:11.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41322025-01-17T08:34:11.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41332025-01-17T08:34:11.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41342025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41352025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41362025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41372025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41382025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41392025-01-17T08:34:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41402025-01-17T08:34:11.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41412025-01-17T08:34:11.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41422025-01-17T08:34:11.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41432025-01-17T08:34:11.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41442025-01-17T08:34:11.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1961, tv_nsec: 79525507 } })
41452025-01-17T08:34:11.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
41462025-01-17T08:34:11.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41472025-01-17T08:34:11.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41482025-01-17T08:34:11.919ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492025-01-17T08:34:11.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41502025-01-17T08:34:11.922ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41512025-01-17T08:34:11.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41522025-01-17T08:34:11.931ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41532025-01-17T08:34:11.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41542025-01-17T08:34:11.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.287023ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
41552025-01-17T08:34:11.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41562025-01-17T08:34:11.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41572025-01-17T08:34:11.939ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41582025-01-17T08:34:11.939ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41592025-01-17T08:34:11.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41602025-01-17T08:34:11.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41612025-01-17T08:34:11.940ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41622025-01-17T08:34:11.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41632025-01-17T08:34:11.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41642025-01-17T08:34:11.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41652025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41662025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41672025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.06559ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
41682025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41692025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41702025-01-17T08:34:11.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712025-01-17T08:34:11.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41722025-01-17T08:34:11.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41732025-01-17T08:34:11.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742025-01-17T08:34:11.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41752025-01-17T08:34:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
41762025-01-17T08:34:11.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41772025-01-17T08:34:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41782025-01-17T08:34:11.945ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41792025-01-17T08:34:11.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.102576ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41802025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41812025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41822025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41832025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
41842025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41852025-01-17T08:34:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41862025-01-17T08:34:11.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.472102ms iteration = 22 status = 0
41872025-01-17T08:34:11.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882025-01-17T08:34:11.954ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41892025-01-17T08:34:11.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41902025-01-17T08:34:11.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41912025-01-17T08:34:11.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.904951ms iteration = 25 status = {"physical_disks_added":0}
41922025-01-17T08:34:11.961ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41932025-01-17T08:34:11.962ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
41942025-01-17T08:34:11.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.833658ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
41952025-01-17T08:34:11.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41962025-01-17T08:34:11.965ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972025-01-17T08:34:11.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.546245ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41982025-01-17T08:34:11.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bccae3ea-ad06-4567-908e-f7bae5708b9a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
41992025-01-17T08:34:11.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42002025-01-17T08:34:11.967ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42012025-01-17T08:34:11.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42022025-01-17T08:34:11.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bccae3ea-ad06-4567-908e-f7bae5708b9a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
42032025-01-17T08:34:11.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bccae3ea-ad06-4567-908e-f7bae5708b9a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
42042025-01-17T08:34:11.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
42052025-01-17T08:34:11.973ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42062025-01-17T08:34:11.974ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09861788-ccd7-4ac6-aec4-bd6c4bfc663e", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42072025-01-17T08:34:11.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42082025-01-17T08:34:11.975ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42092025-01-17T08:34:11.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.868204ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42102025-01-17T08:34:11.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.155535ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42112025-01-17T08:34:11.984ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42122025-01-17T08:34:11.984ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42132025-01-17T08:34:11.984ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42142025-01-17T08:34:11.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42152025-01-17T08:34:11.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.070748ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42162025-01-17T08:34:11.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
42172025-01-17T08:34:11.994ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42182025-01-17T08:34:11.994ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2b54eab-f4fd-41cd-a4b0-8c0112631fe6", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42192025-01-17T08:34:11.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42202025-01-17T08:34:11.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42212025-01-17T08:34:11.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42222025-01-17T08:34:11.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42232025-01-17T08:34:12.002ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
42242025-01-17T08:34:12.002ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 117.309978ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42252025-01-17T08:34:12.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
42262025-01-17T08:34:12.016ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42272025-01-17T08:34:12.016ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "beac3d20-0555-4663-bee2-7a1c1210df01", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42282025-01-17T08:34:12.016ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42292025-01-17T08:34:12.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
42302025-01-17T08:34:12.019ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42312025-01-17T08:34:12.019ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42322025-01-17T08:34:12.019ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.840689ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42332025-01-17T08:34:12.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42342025-01-17T08:34:12.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42352025-01-17T08:34:12.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362025-01-17T08:34:12.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42372025-01-17T08:34:12.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42382025-01-17T08:34:12.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42392025-01-17T08:34:12.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402025-01-17T08:34:12.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42412025-01-17T08:34:12.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42422025-01-17T08:34:12.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42432025-01-17T08:34:12.081ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.678169ms iteration = 22 status = {}
42442025-01-17T08:34:12.109ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42452025-01-17T08:34:12.109ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2fe9027-2e87-4a9f-9201-3fdc64043656", "content-length": "1", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42462025-01-17T08:34:12.111ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42472025-01-17T08:34:12.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42482025-01-17T08:34:12.113ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.175175ms iteration = 22 status = null
42492025-01-17T08:34:12.201ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42502025-01-17T08:34:12.202ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3a2d0b2-ea11-45cf-a35e-279d94ef0bc0", "content-length": "691", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42512025-01-17T08:34:12.202ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42522025-01-17T08:34:12.202ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42532025-01-17T08:34:12.202ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42542025-01-17T08:34:12.203ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.229918ms iteration = 22 status = {}
42552025-01-17T08:34:12.227ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42562025-01-17T08:34:12.227ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42572025-01-17T08:34:12.228ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6be58cc2-8c98-4d69-8cd8-f386ee0746eb", "content-length": "372", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42582025-01-17T08:34:12.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42592025-01-17T08:34:12.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42602025-01-17T08:34:12.269ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42612025-01-17T08:34:12.269ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42622025-01-17T08:34:12.269ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4add52da-c0a4-41e4-87ab-2a4154a88a85", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42632025-01-17T08:34:12.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42642025-01-17T08:34:12.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42652025-01-17T08:34:12.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42662025-01-17T08:34:12.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42672025-01-17T08:34:12.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42682025-01-17T08:34:12.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42692025-01-17T08:34:12.279ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42702025-01-17T08:34:12.279ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42712025-01-17T08:34:12.279ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eaf39cae-12a1-4567-bd6e-6b0e17862501", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42722025-01-17T08:34:12.281ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 390.359929ms iteration = 22 status = {}
42732025-01-17T08:34:12.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42742025-01-17T08:34:12.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42752025-01-17T08:34:12.290ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
42762025-01-17T08:34:12.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42772025-01-17T08:34:12.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42782025-01-17T08:34:12.299ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42792025-01-17T08:34:12.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "197d25e7-2df7-4266-b0a4-3ecfb5975536", "content-length": "134", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42802025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42812025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
42822025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42832025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42842025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42852025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42862025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42872025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42882025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42892025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42902025-01-17T08:34:12.300ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
42912025-01-17T08:34:12.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42922025-01-17T08:34:12.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42932025-01-17T08:34:12.302ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42942025-01-17T08:34:12.303ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc4b04e5-cd1a-400f-9db2-c7ac50c60944", "content-length": "2", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42952025-01-17T08:34:12.303ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42962025-01-17T08:34:12.303ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2836b73-b7c3-4f4f-a91a-b62d264c8463", "content-length": "52", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
42972025-01-17T08:34:12.303ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
42982025-01-17T08:34:12.303ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42992025-01-17T08:34:12.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d19ae0b5-446e-4fe6-94ff-fb3f0b58d509", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
43002025-01-17T08:34:12.394ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
43012025-01-17T08:34:12.394ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43022025-01-17T08:34:12.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e353806-bed4-4216-8854-3b9bbbb605ab", "content-length": "682", "date": "Fri, 17 Jan 2025 08:34:11 GMT"} })
43032025-01-17T08:34:12.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43042025-01-17T08:34:12.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43052025-01-17T08:34:12.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43062025-01-17T08:34:12.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43072025-01-17T08:34:12.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43082025-01-17T08:34:12.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43092025-01-17T08:34:12.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43102025-01-17T08:34:12.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43112025-01-17T08:34:12.411ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 526.029832ms iteration = 22 status = {}
43122025-01-17T08:34:12.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 79728e3f-23ff-4354-910d-87b5b8c52094 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
43132025-01-17T08:34:12.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 79728e3f-23ff-4354-910d-87b5b8c52094 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
43142025-01-17T08:34:12.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3548 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 79728e3f-23ff-4354-910d-87b5b8c52094 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
43152025-01-17T08:34:12.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2366810-cb51-4bc7-a518-68690a1d2f02 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43162025-01-17T08:34:12.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2366810-cb51-4bc7-a518-68690a1d2f02 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43172025-01-17T08:34:12.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2366810-cb51-4bc7-a518-68690a1d2f02 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43182025-01-17T08:34:13.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = ef8f1415-e94d-4276-bdb8-53760c935458 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
43192025-01-17T08:34:14.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1dcc8849-6b97-46ea-b212-958c454d1690 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43202025-01-17T08:34:14.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1dcc8849-6b97-46ea-b212-958c454d1690 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43212025-01-17T08:34:14.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1dcc8849-6b97-46ea-b212-958c454d1690 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43222025-01-17T08:34:15.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bb48d390-21c0-4bdb-a6dc-00717f10acc3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43232025-01-17T08:34:15.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bb48d390-21c0-4bdb-a6dc-00717f10acc3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43242025-01-17T08:34:15.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bb48d390-21c0-4bdb-a6dc-00717f10acc3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43252025-01-17T08:34:16.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 04ee2a09-8b5e-4131-a7a6-d60818e69d0a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43262025-01-17T08:34:16.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 04ee2a09-8b5e-4131-a7a6-d60818e69d0a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43272025-01-17T08:34:16.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 04ee2a09-8b5e-4131-a7a6-d60818e69d0a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43282025-01-17T08:34:17.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea6a7d5b-5f47-462e-9560-db841302bd94 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43292025-01-17T08:34:17.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea6a7d5b-5f47-462e-9560-db841302bd94 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43302025-01-17T08:34:17.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea6a7d5b-5f47-462e-9560-db841302bd94 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43312025-01-17T08:34:18.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c2e9cf00-a886-4cbc-8974-68789ab37ac7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43322025-01-17T08:34:18.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c2e9cf00-a886-4cbc-8974-68789ab37ac7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43332025-01-17T08:34:18.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c2e9cf00-a886-4cbc-8974-68789ab37ac7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43342025-01-17T08:34:19.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45bbf00f-ec2c-409a-a59d-dd242f01ad09 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43352025-01-17T08:34:19.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45bbf00f-ec2c-409a-a59d-dd242f01ad09 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43362025-01-17T08:34:19.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45bbf00f-ec2c-409a-a59d-dd242f01ad09 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43372025-01-17T08:34:20.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51a41bf5-014d-42e5-9c92-dd4bcee09674 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43382025-01-17T08:34:20.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51a41bf5-014d-42e5-9c92-dd4bcee09674 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43392025-01-17T08:34:20.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51a41bf5-014d-42e5-9c92-dd4bcee09674 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43402025-01-17T08:34:21.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b6902892-efe0-498e-aab4-235e1380fbf5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43412025-01-17T08:34:21.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b6902892-efe0-498e-aab4-235e1380fbf5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43422025-01-17T08:34:21.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b6902892-efe0-498e-aab4-235e1380fbf5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43432025-01-17T08:34:21.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
43442025-01-17T08:34:21.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43452025-01-17T08:34:21.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43462025-01-17T08:34:21.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472025-01-17T08:34:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43482025-01-17T08:34:21.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43492025-01-17T08:34:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43502025-01-17T08:34:21.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
43512025-01-17T08:34:21.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43522025-01-17T08:34:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43532025-01-17T08:34:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43542025-01-17T08:34:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43552025-01-17T08:34:21.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43562025-01-17T08:34:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43572025-01-17T08:34:21.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582025-01-17T08:34:21.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.080134ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43592025-01-17T08:34:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
43602025-01-17T08:34:21.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43612025-01-17T08:34:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43622025-01-17T08:34:21.904ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
43632025-01-17T08:34:21.904ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.643636ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
43642025-01-17T08:34:22.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 343ef79c-c588-498e-a839-69372ce80c3b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43652025-01-17T08:34:22.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 343ef79c-c588-498e-a839-69372ce80c3b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43662025-01-17T08:34:22.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 343ef79c-c588-498e-a839-69372ce80c3b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43672025-01-17T08:34:23.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d83371c3-d40d-4e13-b2a5-47a3eeddb675 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43682025-01-17T08:34:23.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d83371c3-d40d-4e13-b2a5-47a3eeddb675 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43692025-01-17T08:34:23.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d83371c3-d40d-4e13-b2a5-47a3eeddb675 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43702025-01-17T08:34:23.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = a913a080-1074-45c4-a9c1-e7bf8becb6e0 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
43712025-01-17T08:34:23.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 3a9557f0-ff78-4f01-8a8b-5a355d3cc633 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
43722025-01-17T08:34:23.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 3a9557f0-ff78-4f01-8a8b-5a355d3cc633 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
43732025-01-17T08:34:23.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3054 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 3a9557f0-ff78-4f01-8a8b-5a355d3cc633 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
43742025-01-17T08:34:23.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91a0b319-7632-4a2d-a0dc-08ec20a8dd11 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
43752025-01-17T08:34:23.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91a0b319-7632-4a2d-a0dc-08ec20a8dd11 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
43762025-01-17T08:34:23.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91a0b319-7632-4a2d-a0dc-08ec20a8dd11 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
43772025-01-17T08:34:24.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 029924ab-ad9e-465e-b11d-053c438a7942 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43782025-01-17T08:34:24.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 029924ab-ad9e-465e-b11d-053c438a7942 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43792025-01-17T08:34:24.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 029924ab-ad9e-465e-b11d-053c438a7942 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43802025-01-17T08:34:25.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df4dcae1-e91e-4e0b-a655-47fba2da5778 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43812025-01-17T08:34:25.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df4dcae1-e91e-4e0b-a655-47fba2da5778 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43822025-01-17T08:34:25.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = df4dcae1-e91e-4e0b-a655-47fba2da5778 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43832025-01-17T08:34:26.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33a43988-4680-43f4-b8b9-def9d528abbf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43842025-01-17T08:34:26.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33a43988-4680-43f4-b8b9-def9d528abbf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43852025-01-17T08:34:26.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 33a43988-4680-43f4-b8b9-def9d528abbf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43862025-01-17T08:34:27.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87336acf-ca1f-4fc1-8270-0e85971e2d4e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43872025-01-17T08:34:27.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87336acf-ca1f-4fc1-8270-0e85971e2d4e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43882025-01-17T08:34:27.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 87336acf-ca1f-4fc1-8270-0e85971e2d4e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43892025-01-17T08:34:28.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dbe135a7-1fc0-4b57-a23b-9187b4782acf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43902025-01-17T08:34:28.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dbe135a7-1fc0-4b57-a23b-9187b4782acf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43912025-01-17T08:34:28.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dbe135a7-1fc0-4b57-a23b-9187b4782acf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43922025-01-17T08:34:29.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a30979e6-d96c-4d70-bbbd-a8cb887abfc1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43932025-01-17T08:34:29.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a30979e6-d96c-4d70-bbbd-a8cb887abfc1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43942025-01-17T08:34:29.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a30979e6-d96c-4d70-bbbd-a8cb887abfc1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
43952025-01-17T08:34:30.393ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e17ffb88-0107-4ba6-aa4d-bf5e079a76a3 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T08:34:30.373617459Z }
43962025-01-17T08:34:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e17ffb88-0107-4ba6-aa4d-bf5e079a76a3 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
43972025-01-17T08:34:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e17ffb88-0107-4ba6-aa4d-bf5e079a76a3 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
43982025-01-17T08:34:30.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47093 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e17ffb88-0107-4ba6-aa4d-bf5e079a76a3 response_code = 204 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
43992025-01-17T08:34:30.421ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 580c6dd2-c46e-4bdb-99df-0b18127a66ca uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T08:34:30.421494589Z }
44002025-01-17T08:34:30.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 580c6dd2-c46e-4bdb-99df-0b18127a66ca roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44012025-01-17T08:34:30.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 580c6dd2-c46e-4bdb-99df-0b18127a66ca resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44022025-01-17T08:34:30.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9570 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 580c6dd2-c46e-4bdb-99df-0b18127a66ca response_code = 204 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44032025-01-17T08:34:31.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7bdf1b3-52c2-4b56-a3c5-ccf83039216c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44042025-01-17T08:34:31.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7bdf1b3-52c2-4b56-a3c5-ccf83039216c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44052025-01-17T08:34:31.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f7bdf1b3-52c2-4b56-a3c5-ccf83039216c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44062025-01-17T08:34:31.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
44072025-01-17T08:34:31.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44082025-01-17T08:34:31.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44092025-01-17T08:34:31.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102025-01-17T08:34:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44112025-01-17T08:34:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44122025-01-17T08:34:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44132025-01-17T08:34:31.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
44142025-01-17T08:34:31.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44152025-01-17T08:34:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44162025-01-17T08:34:31.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44172025-01-17T08:34:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44182025-01-17T08:34:31.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44192025-01-17T08:34:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44202025-01-17T08:34:31.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212025-01-17T08:34:31.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.85276ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44222025-01-17T08:34:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
44232025-01-17T08:34:31.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44242025-01-17T08:34:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44252025-01-17T08:34:31.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
44262025-01-17T08:34:31.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.160431ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
44272025-01-17T08:34:32.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6454921c-9f8c-4141-a584-0a35bfa3e5c5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44282025-01-17T08:34:32.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6454921c-9f8c-4141-a584-0a35bfa3e5c5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44292025-01-17T08:34:32.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6454921c-9f8c-4141-a584-0a35bfa3e5c5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44302025-01-17T08:34:33.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 283f239f-1dba-4a31-944c-d89c85c8a21f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44312025-01-17T08:34:33.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 283f239f-1dba-4a31-944c-d89c85c8a21f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44322025-01-17T08:34:33.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 283f239f-1dba-4a31-944c-d89c85c8a21f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44332025-01-17T08:34:33.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 3c3aea1e-5ff0-4d7f-bb89-87ace70c6581 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
44342025-01-17T08:34:34.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49af19dd-c85a-4863-855d-6f3facb5acef roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44352025-01-17T08:34:34.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49af19dd-c85a-4863-855d-6f3facb5acef resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44362025-01-17T08:34:34.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49af19dd-c85a-4863-855d-6f3facb5acef response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44372025-01-17T08:34:35.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0b1cbcb0-0f32-402e-9e3d-611a8154f7ec roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44382025-01-17T08:34:35.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0b1cbcb0-0f32-402e-9e3d-611a8154f7ec resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44392025-01-17T08:34:35.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0b1cbcb0-0f32-402e-9e3d-611a8154f7ec response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44402025-01-17T08:34:36.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9ec2a1ab-a556-4c26-8915-8810442e5557 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44412025-01-17T08:34:36.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9ec2a1ab-a556-4c26-8915-8810442e5557 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44422025-01-17T08:34:36.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9ec2a1ab-a556-4c26-8915-8810442e5557 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44432025-01-17T08:34:37.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5fcac295-da61-4519-b30f-1d3f741f54c5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44442025-01-17T08:34:37.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5fcac295-da61-4519-b30f-1d3f741f54c5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44452025-01-17T08:34:37.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5fcac295-da61-4519-b30f-1d3f741f54c5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44462025-01-17T08:34:38.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d1bfcb0-b0e4-4ad0-91cb-48c772990143 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44472025-01-17T08:34:38.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d1bfcb0-b0e4-4ad0-91cb-48c772990143 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44482025-01-17T08:34:38.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3d1bfcb0-b0e4-4ad0-91cb-48c772990143 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44492025-01-17T08:34:39.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2f7d5d-78be-4adc-82f9-3029f504e6e4 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44502025-01-17T08:34:39.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2f7d5d-78be-4adc-82f9-3029f504e6e4 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44512025-01-17T08:34:39.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae2f7d5d-78be-4adc-82f9-3029f504e6e4 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44522025-01-17T08:34:40.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5c23c77b-08a1-4ac2-9072-dbaba50cd8e9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44532025-01-17T08:34:40.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5c23c77b-08a1-4ac2-9072-dbaba50cd8e9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44542025-01-17T08:34:40.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5c23c77b-08a1-4ac2-9072-dbaba50cd8e9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44552025-01-17T08:34:40.962ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdef6a92-4209-459d-8b4d-ee5fe87426cd uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T08:34:40.962525588Z }
44562025-01-17T08:34:40.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdef6a92-4209-459d-8b4d-ee5fe87426cd roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44572025-01-17T08:34:40.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdef6a92-4209-459d-8b4d-ee5fe87426cd resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44582025-01-17T08:34:40.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8807 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdef6a92-4209-459d-8b4d-ee5fe87426cd response_code = 204 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
44592025-01-17T08:34:41.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91ba4c88-5ce4-4569-9527-6ea614821023 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
44602025-01-17T08:34:41.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91ba4c88-5ce4-4569-9527-6ea614821023 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
44612025-01-17T08:34:41.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 91ba4c88-5ce4-4569-9527-6ea614821023 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
44622025-01-17T08:34:41.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ca79af7-86d8-49fe-9dbe-b7394504a85f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
44632025-01-17T08:34:41.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ca79af7-86d8-49fe-9dbe-b7394504a85f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
44642025-01-17T08:34:41.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 7ca79af7-86d8-49fe-9dbe-b7394504a85f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
44652025-01-17T08:34:41.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b435d6bf-06d4-4af2-9c50-661585c25d5e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44662025-01-17T08:34:41.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b435d6bf-06d4-4af2-9c50-661585c25d5e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44672025-01-17T08:34:41.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b435d6bf-06d4-4af2-9c50-661585c25d5e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
44682025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
44692025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
44702025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
44712025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44722025-01-17T08:34:41.884ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:24:41.884113319 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
44732025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
44742025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
44752025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
44762025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
44772025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
44782025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
44792025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44802025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
44812025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44822025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
44832025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
44842025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44852025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
44862025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44872025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
44882025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44892025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
44902025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44912025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44922025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44932025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
44942025-01-17T08:34:41.884ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
44952025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44962025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
44972025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44982025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
44992025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
45002025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45012025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45022025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
45032025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45042025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
45052025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45062025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
45072025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45082025-01-17T08:34:41.884ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
45092025-01-17T08:34:41.885ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
45102025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.16\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
45112025-01-17T08:34:41.885ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 58638281 } })
45122025-01-17T08:34:41.885ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 58647532 } })
45132025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45142025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45152025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45162025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45172025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45182025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45192025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45202025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45222025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45232025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45242025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45252025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
45262025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.336971ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
45272025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
45282025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.330511ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
45292025-01-17T08:34:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45302025-01-17T08:34:41.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45312025-01-17T08:34:41.886ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
45322025-01-17T08:34:41.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45332025-01-17T08:34:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45342025-01-17T08:34:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45352025-01-17T08:34:41.887ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:24:41.884113319 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
45362025-01-17T08:34:41.887ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.200636ms iteration = 12 status = {"expiration":"2025-01-17T08:24:41.884113319Z","pruned":[]}
45372025-01-17T08:34:41.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45382025-01-17T08:34:41.889ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.08757ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45392025-01-17T08:34:41.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45402025-01-17T08:34:41.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45412025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
45422025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
45432025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45442025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45452025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
45462025-01-17T08:34:41.891ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45472025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45482025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
45492025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45502025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45512025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45522025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45532025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45542025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45552025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45562025-01-17T08:34:41.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 65568946 } })
45572025-01-17T08:34:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45582025-01-17T08:34:41.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
45592025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45602025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45612025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45622025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45632025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45642025-01-17T08:34:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45652025-01-17T08:34:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45662025-01-17T08:34:41.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45672025-01-17T08:34:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45682025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45692025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
45702025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
45712025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45722025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45732025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
45742025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45752025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
45762025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45772025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
45782025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45792025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
45802025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45812025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45822025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45832025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45842025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45852025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45862025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45872025-01-17T08:34:41.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45882025-01-17T08:34:41.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45892025-01-17T08:34:41.896ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 69890270 } })
45902025-01-17T08:34:41.896ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
45912025-01-17T08:34:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45922025-01-17T08:34:41.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45932025-01-17T08:34:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45942025-01-17T08:34:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45952025-01-17T08:34:41.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45962025-01-17T08:34:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45972025-01-17T08:34:41.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982025-01-17T08:34:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45992025-01-17T08:34:41.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46002025-01-17T08:34:41.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46012025-01-17T08:34:41.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46022025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46032025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46042025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46052025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46062025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46072025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46082025-01-17T08:34:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46092025-01-17T08:34:41.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46102025-01-17T08:34:41.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46112025-01-17T08:34:41.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46122025-01-17T08:34:41.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46132025-01-17T08:34:41.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46142025-01-17T08:34:41.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46152025-01-17T08:34:41.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46162025-01-17T08:34:41.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46172025-01-17T08:34:41.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46182025-01-17T08:34:41.915ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.079927ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
46192025-01-17T08:34:41.915ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1991, tv_nsec: 89060762 } })
46202025-01-17T08:34:41.915ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
46212025-01-17T08:34:41.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222025-01-17T08:34:41.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
46232025-01-17T08:34:41.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46242025-01-17T08:34:41.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46252025-01-17T08:34:41.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-01-17T08:34:41.926ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
46282025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46292025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46302025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46312025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46322025-01-17T08:34:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46332025-01-17T08:34:41.942ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342025-01-17T08:34:41.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46352025-01-17T08:34:41.945ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46362025-01-17T08:34:41.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46372025-01-17T08:34:41.947ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
46382025-01-17T08:34:41.947ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
46392025-01-17T08:34:41.947ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
46402025-01-17T08:34:41.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46412025-01-17T08:34:41.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46422025-01-17T08:34:41.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46432025-01-17T08:34:41.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46442025-01-17T08:34:41.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46452025-01-17T08:34:41.952ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46462025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46472025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46482025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.307132ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
46492025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46502025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46512025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46522025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46532025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46542025-01-17T08:34:41.952ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46552025-01-17T08:34:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46562025-01-17T08:34:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46572025-01-17T08:34:41.954ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46582025-01-17T08:34:41.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46592025-01-17T08:34:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46602025-01-17T08:34:41.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46612025-01-17T08:34:41.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46622025-01-17T08:34:41.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.907375ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
46632025-01-17T08:34:41.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46642025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.126447ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46652025-01-17T08:34:41.960ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46662025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46672025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46682025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
46692025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.027161ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
46702025-01-17T08:34:41.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46712025-01-17T08:34:41.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.04058ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46722025-01-17T08:34:41.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46732025-01-17T08:34:41.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46742025-01-17T08:34:41.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46752025-01-17T08:34:41.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46762025-01-17T08:34:41.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46772025-01-17T08:34:41.965ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46782025-01-17T08:34:41.965ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46792025-01-17T08:34:41.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46802025-01-17T08:34:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46812025-01-17T08:34:41.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.079539ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46822025-01-17T08:34:41.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832025-01-17T08:34:41.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46842025-01-17T08:34:41.969ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46852025-01-17T08:34:41.969ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46862025-01-17T08:34:41.969ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.362956ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46872025-01-17T08:34:41.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46882025-01-17T08:34:41.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46892025-01-17T08:34:41.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46902025-01-17T08:34:41.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46912025-01-17T08:34:41.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46922025-01-17T08:34:41.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46932025-01-17T08:34:41.977ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46942025-01-17T08:34:41.978ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46952025-01-17T08:34:41.978ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
46962025-01-17T08:34:41.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 93.835642ms iteration = 12 status = {"generation":1}
46972025-01-17T08:34:41.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46982025-01-17T08:34:41.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46992025-01-17T08:34:41.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47002025-01-17T08:34:41.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47012025-01-17T08:34:41.983ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47022025-01-17T08:34:41.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47032025-01-17T08:34:41.983ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47042025-01-17T08:34:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47052025-01-17T08:34:41.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47062025-01-17T08:34:41.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47072025-01-17T08:34:41.996ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47082025-01-17T08:34:41.996ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47092025-01-17T08:34:41.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.170242ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47102025-01-17T08:34:42.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112025-01-17T08:34:42.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47122025-01-17T08:34:42.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47132025-01-17T08:34:42.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47142025-01-17T08:34:42.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.211082ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47152025-01-17T08:34:42.009ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47162025-01-17T08:34:42.009ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47172025-01-17T08:34:42.009ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.852678ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47182025-01-17T08:34:42.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192025-01-17T08:34:42.015ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202025-01-17T08:34:42.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
47212025-01-17T08:34:42.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47222025-01-17T08:34:42.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47232025-01-17T08:34:42.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47242025-01-17T08:34:42.018ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47252025-01-17T08:34:42.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47262025-01-17T08:34:42.018ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47272025-01-17T08:34:42.020ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282025-01-17T08:34:42.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47292025-01-17T08:34:42.022ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47302025-01-17T08:34:42.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47312025-01-17T08:34:42.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47322025-01-17T08:34:42.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47332025-01-17T08:34:42.052ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
47342025-01-17T08:34:42.052ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47352025-01-17T08:34:42.052ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffba9b35-c778-473c-bf9f-efe86064d196", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
47362025-01-17T08:34:42.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47372025-01-17T08:34:42.054ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47382025-01-17T08:34:42.063ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.956966ms iteration = 26 status = {"physical_disks_added":0}
47392025-01-17T08:34:42.074ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47402025-01-17T08:34:42.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 183.406982ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47412025-01-17T08:34:42.093ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
47422025-01-17T08:34:42.093ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47432025-01-17T08:34:42.093ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2703101d-b2bb-4e02-9677-c2bdea799280", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
47442025-01-17T08:34:42.093ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47452025-01-17T08:34:42.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47462025-01-17T08:34:42.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
47472025-01-17T08:34:42.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
47482025-01-17T08:34:42.243ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
47492025-01-17T08:34:42.243ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47502025-01-17T08:34:42.244ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f9839c-2b46-49e8-a497-b965b14ff772", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
47512025-01-17T08:34:42.244ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47522025-01-17T08:34:42.246ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
47532025-01-17T08:34:42.276ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47542025-01-17T08:34:42.276ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f79cee51-a389-4ffc-8e43-3cb2d4ae89e5", "content-length": "2", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
47552025-01-17T08:34:42.278ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47562025-01-17T08:34:42.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47572025-01-17T08:34:42.311ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.553815ms iteration = 23 status = {}
47582025-01-17T08:34:42.327ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 442.969416ms iteration = 23 status = 0
47592025-01-17T08:34:42.327ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/8dc274bd-acbb-41c1-8419-e1186e06c382/state
47602025-01-17T08:34:42.361ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
47612025-01-17T08:34:42.361ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 476.670492ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47622025-01-17T08:34:42.361ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
47632025-01-17T08:34:42.361ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
47642025-01-17T08:34:42.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47652025-01-17T08:34:42.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47662025-01-17T08:34:42.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47672025-01-17T08:34:42.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d4d0f408-91fd-47b7-98fa-1380792f85c6", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47682025-01-17T08:34:42.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47692025-01-17T08:34:42.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "694f26d0-41c0-4bbd-b84b-79411c4c581a", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47702025-01-17T08:34:42.372ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47712025-01-17T08:34:42.373ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
47722025-01-17T08:34:42.373ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 488.476036ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47732025-01-17T08:34:42.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ff73511a-8c70-4a74-bb79-e82def1e07ec", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47742025-01-17T08:34:42.374ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47752025-01-17T08:34:42.377ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
47762025-01-17T08:34:42.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.881869ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
47772025-01-17T08:34:42.379ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47782025-01-17T08:34:42.379ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47792025-01-17T08:34:42.379ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe5fefd-f3ac-4817-9664-3985902a6263", "content-length": "585", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
47802025-01-17T08:34:42.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47812025-01-17T08:34:42.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47822025-01-17T08:34:42.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832025-01-17T08:34:42.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842025-01-17T08:34:42.381ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 496.834641ms iteration = 23 status = null
47852025-01-17T08:34:42.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47862025-01-17T08:34:42.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47872025-01-17T08:34:42.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47882025-01-17T08:34:42.383ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47892025-01-17T08:34:42.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "be2fb501-fb6a-42f8-914a-ea42618a33c9", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47902025-01-17T08:34:42.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47912025-01-17T08:34:42.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47922025-01-17T08:34:42.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47932025-01-17T08:34:42.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47942025-01-17T08:34:42.385ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dcca334e-1f6c-4955-b450-3a6ccdb56d7e", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47952025-01-17T08:34:42.385ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47962025-01-17T08:34:42.386ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
47972025-01-17T08:34:42.386ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47982025-01-17T08:34:42.386ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
47992025-01-17T08:34:42.386ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 502.400845ms iteration = 12 status = {"generation":2}
48002025-01-17T08:34:42.387ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
48012025-01-17T08:34:42.387ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 502.95209ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48022025-01-17T08:34:42.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48032025-01-17T08:34:42.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48042025-01-17T08:34:42.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48052025-01-17T08:34:42.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48062025-01-17T08:34:42.424ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {60f23a6c-0eab-437e-b374-a5b99b9e0d54: {10.151.2.175: {8abf940b-896d-46ba-8103-17a071fd4f76}, 10.151.2.176: {8abf940b-896d-46ba-8103-17a071fd4f76}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48072025-01-17T08:34:42.424ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48082025-01-17T08:34:42.424ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "586188c3-4e26-4594-a08e-a22c4cf1eab3", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48092025-01-17T08:34:42.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48102025-01-17T08:34:42.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48112025-01-17T08:34:42.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48122025-01-17T08:34:42.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48132025-01-17T08:34:42.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48142025-01-17T08:34:42.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48152025-01-17T08:34:42.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48162025-01-17T08:34:42.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48172025-01-17T08:34:42.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48182025-01-17T08:34:42.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48192025-01-17T08:34:42.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48202025-01-17T08:34:42.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48212025-01-17T08:34:42.439ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48222025-01-17T08:34:42.439ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48232025-01-17T08:34:42.439ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48242025-01-17T08:34:42.439ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "905d2be9-d71a-43d9-95dc-ca0a7d813378", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48252025-01-17T08:34:42.442ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.891739ms iteration = 23 status = {}
48262025-01-17T08:34:42.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48272025-01-17T08:34:42.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48282025-01-17T08:34:42.461ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
48292025-01-17T08:34:42.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302025-01-17T08:34:42.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48312025-01-17T08:34:42.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48322025-01-17T08:34:42.470ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f23530-344d-4942-857f-ec2afcef456f", "content-length": "134", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
48332025-01-17T08:34:42.470ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48342025-01-17T08:34:42.470ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
48352025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48362025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48372025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48382025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48392025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48402025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48412025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48422025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48432025-01-17T08:34:42.471ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
48442025-01-17T08:34:42.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48452025-01-17T08:34:42.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48462025-01-17T08:34:42.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48472025-01-17T08:34:42.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "63692842-896e-43ff-936d-ae5918d60cae", "content-length": "2", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
48482025-01-17T08:34:42.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48492025-01-17T08:34:42.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "747c5c2f-c198-4436-810d-38bdc566bd8b", "content-length": "52", "date": "Fri, 17 Jan 2025 08:34:41 GMT"} })
48502025-01-17T08:34:42.473ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
48512025-01-17T08:34:42.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48522025-01-17T08:34:42.501ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48532025-01-17T08:34:42.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "81dda8cb-6edb-4429-8bfd-13a42defd628", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48542025-01-17T08:34:42.569ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
48552025-01-17T08:34:42.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48562025-01-17T08:34:42.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6e5affa-3dc1-4c16-a26c-a401d0ac9a30", "content-length": "682", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48572025-01-17T08:34:42.569ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b113deee-2f6a-485f-810e-5954df00c3c7", "content-length": "811", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48582025-01-17T08:34:42.569ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(16430372) }} sled = sock
48592025-01-17T08:34:42.569ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48602025-01-17T08:34:42.569ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48612025-01-17T08:34:42.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48622025-01-17T08:34:42.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48632025-01-17T08:34:42.571ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 686.420231ms iteration = 23 status = {}
48642025-01-17T08:34:42.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48652025-01-17T08:34:42.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48662025-01-17T08:34:42.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48672025-01-17T08:34:42.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48682025-01-17T08:34:42.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48692025-01-17T08:34:42.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48702025-01-17T08:34:42.587ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 702.459698ms iteration = 23 status = {}
48712025-01-17T08:34:42.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = c4597131-f013-4d0d-ab8a-019fd3ef91ff roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
48722025-01-17T08:34:42.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = c4597131-f013-4d0d-ab8a-019fd3ef91ff resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
48732025-01-17T08:34:42.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = c4597131-f013-4d0d-ab8a-019fd3ef91ff response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
48742025-01-17T08:34:42.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 111bcfe6-f63d-4a09-a1a7-82d4a49192b4 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
48752025-01-17T08:34:42.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 111bcfe6-f63d-4a09-a1a7-82d4a49192b4 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
48762025-01-17T08:34:42.654ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48772025-01-17T08:34:42.654ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
48782025-01-17T08:34:42.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 111bcfe6-f63d-4a09-a1a7-82d4a49192b4 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
48792025-01-17T08:34:42.685ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
48802025-01-17T08:34:42.685ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:35617
48812025-01-17T08:34:42.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35617 req_id = 91088cba-fc03-4c98-a28a-8de9cff3dcd5 roles = RoleSet { roles: {} } uri = /metrics/producers
48822025-01-17T08:34:42.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35617 req_id = 91088cba-fc03-4c98-a28a-8de9cff3dcd5 resource = Database result = Ok(()) uri = /metrics/producers
48832025-01-17T08:34:42.727ZINFOnexus: assigned collector to new producer collector_id = 0cc45a67-34ed-4014-ae46-f6e108da31b8 file = nexus/src/app/oximeter.rs:76 producer_id = b72586ef-ab31-4002-9c99-4f4040a5f525
48842025-01-17T08:34:42.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42361 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:35617 req_id = 91088cba-fc03-4c98-a28a-8de9cff3dcd5 response_code = 201 uri = /metrics/producers
48852025-01-17T08:34:42.727ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "91088cba-fc03-4c98-a28a-8de9cff3dcd5", "content-length": "41", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
48862025-01-17T08:34:42.729ZDEBGnexus (producer-registration-task): registered with nexus successfully
48872025-01-17T08:34:42.729ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48882025-01-17T08:34:43.349ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }
48892025-01-17T08:34:43.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48902025-01-17T08:34:43.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48912025-01-17T08:34:43.383ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_needs_update = true
48922025-01-17T08:34:43.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48932025-01-17T08:34:43.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48942025-01-17T08:34:43.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48952025-01-17T08:34:43.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48962025-01-17T08:34:43.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48972025-01-17T08:34:43.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48982025-01-17T08:34:43.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
48992025-01-17T08:34:43.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49002025-01-17T08:34:43.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49012025-01-17T08:34:43.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49022025-01-17T08:34:43.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49032025-01-17T08:34:43.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49042025-01-17T08:34:43.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49052025-01-17T08:34:43.405ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 603edd29-2275-4ced-9f13-a1ccdff45ca3, lookup_type: ById(603edd29-2275-4ced-9f13-a1ccdff45ca3) }, key: a67a60de-0cac-4068-8294-f4205972bd35, lookup_type: ById(a67a60de-0cac-4068-8294-f4205972bd35) }, key: fe4e411b-6385-4535-894a-f7e7e7ac5d5f, lookup_type: ById(fe4e411b-6385-4535-894a-f7e7e7ac5d5f) } result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49062025-01-17T08:34:43.412ZINFOnexus (dropshot_internal): starting update saga for fe4e411b-6385-4535-894a-f7e7e7ac5d5f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }
49072025-01-17T08:34:43.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67967 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 response_code = 204 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49082025-01-17T08:34:43.417ZDEBGnexus (dropshot_internal): preparing instance-update saga for fe4e411b-6385-4535-894a-f7e7e7ac5d5f... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ae326696-956f-49c3-a570-409283500745 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49092025-01-17T08:34:43.417ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update
49102025-01-17T08:34:43.417ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 366ed9e8-6850-4fa6-b984-80b9d31f4426 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }
49112025-01-17T08:34:43.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 366ed9e8-6850-4fa6-b984-80b9d31f4426 roles = RoleSet { roles: {} } uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49122025-01-17T08:34:43.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 366ed9e8-6850-4fa6-b984-80b9d31f4426 resource = Database result = Ok(()) uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49132025-01-17T08:34:43.419ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"fe4e411b-6385-4535-894a-f7e7e7ac5d5f","lookup_type":{"ById":"fe4e411b-6385-4535-894a-f7e7e7ac5d5f"},"parent":{"key":"a67a60de-0cac-4068-8294-f4205972bd35","lookup_type":{"ById":"a67a60de-0cac-4068-8294-f4205972bd35"},"parent":{"key":"603edd29-2275-4ced-9f13-a1ccdff45ca3","lookup_type":{"ById":"603edd29-2275-4ced-9f13-a1ccdff45ca3"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49142025-01-17T08:34:43.422ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update
49152025-01-17T08:34:43.452ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update
49162025-01-17T08:34:43.452ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49172025-01-17T08:34:43.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35427 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 366ed9e8-6850-4fa6-b984-80b9d31f4426 response_code = 204 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
49182025-01-17T08:34:43.453ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/8dc274bd-acbb-41c1-8419-e1186e06c382/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6f2f6f0-a19b-4413-819f-7917ee1ad559", "content-length": "132", "date": "Fri, 17 Jan 2025 08:34:42 GMT"} })
49192025-01-17T08:34:43.453ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }, migration_in: None, migration_out: None } vmm_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
49202025-01-17T08:34:43.453ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e vmm_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }
49212025-01-17T08:34:43.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f roles = RoleSet { roles: {} } sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e vmm_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
49222025-01-17T08:34:43.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f resource = Database result = Ok(()) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e vmm_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
49232025-01-17T08:34:43.459ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49242025-01-17T08:34:43.461ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49252025-01-17T08:34:43.470ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49262025-01-17T08:34:43.470ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49272025-01-17T08:34:43.473ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49282025-01-17T08:34:43.473ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49292025-01-17T08:34:43.479ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49302025-01-17T08:34:43.479ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5115ab89-96f4-40cb-9092-68be998433b8")) node_id = 0 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49312025-01-17T08:34:43.483ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49322025-01-17T08:34:43.483ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49332025-01-17T08:34:43.485ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
49342025-01-17T08:34:43.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.600878666s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"destroyed":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
49352025-01-17T08:34:43.500ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update
49362025-01-17T08:34:43.500ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49372025-01-17T08:34:43.500ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49382025-01-17T08:34:43.502ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49392025-01-17T08:34:43.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49402025-01-17T08:34:43.504ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49412025-01-17T08:34:43.504ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49422025-01-17T08:34:43.505ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8404 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = c94de701-0ab1-4c96-8b82-4095f30d2f6d response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
49432025-01-17T08:34:43.506ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49442025-01-17T08:34:43.506ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49452025-01-17T08:34:43.508ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49462025-01-17T08:34:43.508ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49472025-01-17T08:34:43.509ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49482025-01-17T08:34:43.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49492025-01-17T08:34:43.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49502025-01-17T08:34:43.513ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 603edd29-2275-4ced-9f13-a1ccdff45ca3, lookup_type: ById(603edd29-2275-4ced-9f13-a1ccdff45ca3) }, key: a67a60de-0cac-4068-8294-f4205972bd35, lookup_type: ById(a67a60de-0cac-4068-8294-f4205972bd35) }, key: fe4e411b-6385-4535-894a-f7e7e7ac5d5f, lookup_type: ById(fe4e411b-6385-4535-894a-f7e7e7ac5d5f) } result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49512025-01-17T08:34:43.513ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5115ab89-96f4-40cb-9092-68be998433b8
49522025-01-17T08:34:43.513ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49532025-01-17T08:34:43.513ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49542025-01-17T08:34:43.525ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5115ab89-96f4-40cb-9092-68be998433b8
49552025-01-17T08:34:43.525ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49562025-01-17T08:34:43.525ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance
49572025-01-17T08:34:43.529ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f locked_gen = Generation(Generation(2)) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5115ab89-96f4-40cb-9092-68be998433b8
49582025-01-17T08:34:43.534ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49592025-01-17T08:34:43.534ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5115ab89-96f4-40cb-9092-68be998433b8")}) node_id = 1 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49602025-01-17T08:34:43.538ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49612025-01-17T08:34:43.538ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
49622025-01-17T08:34:43.544ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49632025-01-17T08:34:43.544ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49642025-01-17T08:34:43.545ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49652025-01-17T08:34:43.545ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49662025-01-17T08:34:43.547ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49672025-01-17T08:34:43.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49682025-01-17T08:34:43.548ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49692025-01-17T08:34:43.551ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 603edd29-2275-4ced-9f13-a1ccdff45ca3, lookup_type: ById(603edd29-2275-4ced-9f13-a1ccdff45ca3) }, key: a67a60de-0cac-4068-8294-f4205972bd35, lookup_type: ById(a67a60de-0cac-4068-8294-f4205972bd35) }, key: fe4e411b-6385-4535-894a-f7e7e7ac5d5f, lookup_type: ById(fe4e411b-6385-4535-894a-f7e7e7ac5d5f) } result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49702025-01-17T08:34:43.551ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49712025-01-17T08:34:43.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49722025-01-17T08:34:43.564ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 8dc274bd-acbb-41c1-8419-e1186e06c382, time_created: 2025-01-17T08:34:22.681744Z, time_deleted: None, instance_id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f, sled_id: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-17T08:34:43.348813Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-17T08:34:20.684784Z, gen: Generation(Generation(3)), propolis_id: Some(8dc274bd-acbb-41c1-8419-e1186e06c382), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(8dc274bd-acbb-41c1-8419-e1186e06c382 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-17T08:34:43.562566079Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
49732025-01-17T08:34:43.569ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
49742025-01-17T08:34:43.569ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"fe4e411b-6385-4535-894a-f7e7e7ac5d5f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"8dc274bd-acbb-41c1-8419-e1186e06c382"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"fe4e411b-6385-4535-894a-f7e7e7ac5d5f","lookup_type":{"ById":"fe4e411b-6385-4535-894a-f7e7e7ac5d5f"},"parent":{"key":"a67a60de-0cac-4068-8294-f4205972bd35","lookup_type":{"ById":"a67a60de-0cac-4068-8294-f4205972bd35"},"parent":{"key":"603edd29-2275-4ced-9f13-a1ccdff45ca3","lookup_type":{"ById":"603edd29-2275-4ced-9f13-a1ccdff45ca3"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"5115ab89-96f4-40cb-9092-68be998433b8"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"a67a60de-0cac-4068-8294-f4205972bd35","ram_diff":1073741824},"destroy_active_vmm":"8dc274bd-acbb-41c1-8419-e1186e06c382","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-17T08:34:43.562566079Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49752025-01-17T08:34:43.569ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
49762025-01-17T08:34:43.601ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
49772025-01-17T08:34:43.601ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49782025-01-17T08:34:43.601ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49792025-01-17T08:34:43.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49802025-01-17T08:34:43.605ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49812025-01-17T08:34:43.605ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49822025-01-17T08:34:43.607ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49832025-01-17T08:34:43.607ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49842025-01-17T08:34:43.611ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49852025-01-17T08:34:43.611ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7")) node_id = 0 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49862025-01-17T08:34:43.614ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49872025-01-17T08:34:43.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49882025-01-17T08:34:43.624ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f parent_lock = UpdaterLock { updater_id: 5115ab89-96f4-40cb-9092-68be998433b8, locked_gen: Generation(Generation(2)) } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
49892025-01-17T08:34:43.624ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = BecomeUpdater
49902025-01-17T08:34:43.625ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = BecomeUpdater
49912025-01-17T08:34:43.637ZDEBGnexus (SagaExecutor): inherited lock from 5115ab89-96f4-40cb-9092-68be998433b8 to d7411c1c-fb94-4fd0-8eb2-82ab215146f7 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 5115ab89-96f4-40cb-9092-68be998433b8 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = BecomeUpdater updater_id = d7411c1c-fb94-4fd0-8eb2-82ab215146f7
49922025-01-17T08:34:43.637ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
49932025-01-17T08:34:43.637ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49942025-01-17T08:34:43.637ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7")}) node_id = 1 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49952025-01-17T08:34:43.640ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49962025-01-17T08:34:43.640ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49972025-01-17T08:34:43.644ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
49982025-01-17T08:34:43.644ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = ab683310-e23e-4530-82f3-569495dd919c
49992025-01-17T08:34:43.647ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50002025-01-17T08:34:43.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50012025-01-17T08:34:43.652ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50022025-01-17T08:34:43.652ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f
50032025-01-17T08:34:43.654ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50042025-01-17T08:34:43.654ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50052025-01-17T08:34:43.660ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50062025-01-17T08:34:43.660ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50072025-01-17T08:34:43.662ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
50082025-01-17T08:34:43.662ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50092025-01-17T08:34:43.663ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UpdateNetworkConfig
50102025-01-17T08:34:43.664ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
50112025-01-17T08:34:43.664ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
50122025-01-17T08:34:43.664ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
50132025-01-17T08:34:43.666ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
50142025-01-17T08:34:43.667ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
50152025-01-17T08:34:43.667ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
50162025-01-17T08:34:43.667ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
50172025-01-17T08:34:43.671ZDEBGnexus: notifying dendrite of updates instance_id = Some(fe4e411b-6385-4535-894a-f7e7e7ac5d5f (instance)) switch = switch0
50182025-01-17T08:34:43.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1992, tv_nsec: 845806172 } })
50192025-01-17T08:34:43.672ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
50202025-01-17T08:34:43.702ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
50212025-01-17T08:34:43.702ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50222025-01-17T08:34:43.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51e2f316-d4a9-4387-896c-80d88f76421c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
50232025-01-17T08:34:43.703ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7345470e-7136-4997-add1-60dc11df0e6b", "content-length": "26", "date": "Fri, 17 Jan 2025 08:34:43 GMT"} })
50242025-01-17T08:34:43.703ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50252025-01-17T08:34:43.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51e2f316-d4a9-4387-896c-80d88f76421c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
50262025-01-17T08:34:43.704ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50272025-01-17T08:34:43.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 51e2f316-d4a9-4387-896c-80d88f76421c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
50282025-01-17T08:34:43.735ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
50292025-01-17T08:34:43.735ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "b357632c-6408-4ed8-99ee-62b83df8c2de", "content-length": "4", "date": "Fri, 17 Jan 2025 08:34:43 GMT"} })
50302025-01-17T08:34:43.737ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50312025-01-17T08:34:43.737ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50322025-01-17T08:34:43.740ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50332025-01-17T08:34:43.740ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50342025-01-17T08:34:43.745ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
50352025-01-17T08:34:43.745ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ReleaseVirtualProvisioning
50362025-01-17T08:34:43.765ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-17T08:34:43.753162Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, time_modified: Some(2025-01-17T08:34:43.753162Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a67a60de-0cac-4068-8294-f4205972bd35, time_modified: Some(2025-01-17T08:34:43.753162Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50372025-01-17T08:34:43.765ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50382025-01-17T08:34:43.765ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50392025-01-17T08:34:43.769ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50402025-01-17T08:34:43.769ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50412025-01-17T08:34:43.776ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50422025-01-17T08:34:43.776ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UnassignOximeterProducer
50432025-01-17T08:34:43.777ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UnassignOximeterProducer
50442025-01-17T08:34:43.782ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 0cc45a67-34ed-4014-ae46-f6e108da31b8 producer_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50452025-01-17T08:34:43.782ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UnassignOximeterProducer
50462025-01-17T08:34:43.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = UnassignOximeterProducer
50472025-01-17T08:34:43.839ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50482025-01-17T08:34:43.841ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/fe4e411b-6385-4535-894a-f7e7e7ac5d5f
50492025-01-17T08:34:43.868ZDEBGnexus (SagaExecutor): client response oximeter-collector = fe4e411b-6385-4535-894a-f7e7e7ac5d5f result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/fe4e411b-6385-4535-894a-f7e7e7ac5d5f", status: 204, headers: {"x-request-id": "39612a36-36e4-4560-b63d-79108bd7a2e9", "date": "Fri, 17 Jan 2025 08:34:43 GMT"} }) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50502025-01-17T08:34:43.868ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 0cc45a67-34ed-4014-ae46-f6e108da31b8 producer_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50512025-01-17T08:34:43.870ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50522025-01-17T08:34:43.870ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50532025-01-17T08:34:43.886ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50542025-01-17T08:34:43.886ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50552025-01-17T08:34:43.891ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f lock = UpdaterLock { updater_id: d7411c1c-fb94-4fd0-8eb2-82ab215146f7, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-17T08:34:43.562566079Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50562025-01-17T08:34:43.891ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = CommitInstanceUpdates
50572025-01-17T08:34:43.892ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = CommitInstanceUpdates
50582025-01-17T08:34:43.938ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f new_runtime = InstanceRuntimeState { time_updated: 2025-01-17T08:34:43.562566079Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50592025-01-17T08:34:43.938ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50602025-01-17T08:34:43.938ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50612025-01-17T08:34:43.938ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
50622025-01-17T08:34:43.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50632025-01-17T08:34:43.938ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
50642025-01-17T08:34:43.938ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50652025-01-17T08:34:43.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50662025-01-17T08:34:43.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50672025-01-17T08:34:43.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50682025-01-17T08:34:43.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50692025-01-17T08:34:43.943ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50702025-01-17T08:34:43.943ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50712025-01-17T08:34:43.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50722025-01-17T08:34:43.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50732025-01-17T08:34:43.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50742025-01-17T08:34:43.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50752025-01-17T08:34:43.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50762025-01-17T08:34:43.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50772025-01-17T08:34:43.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50782025-01-17T08:34:43.950ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50792025-01-17T08:34:43.950ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("fe4e411b-6385-4535-894a-f7e7e7ac5d5f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("8dc274bd-acbb-41c1-8419-e1186e06c382")}) node_id = 7 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50802025-01-17T08:34:43.963ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50812025-01-17T08:34:43.963ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50822025-01-17T08:34:43.970ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50832025-01-17T08:34:43.970ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50842025-01-17T08:34:43.974ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50852025-01-17T08:34:43.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50862025-01-17T08:34:43.978ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50872025-01-17T08:34:43.978ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ReleaseSledResources
50882025-01-17T08:34:43.978ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ReleaseSledResources
50892025-01-17T08:34:43.982ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50902025-01-17T08:34:43.982ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50912025-01-17T08:34:43.985ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50922025-01-17T08:34:43.985ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50932025-01-17T08:34:43.989ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
50942025-01-17T08:34:43.989ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = MarkVmmDeleted
50952025-01-17T08:34:43.989ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = MarkVmmDeleted
50962025-01-17T08:34:44.000ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50972025-01-17T08:34:44.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ab683310-e23e-4530-82f3-569495dd919c
50982025-01-17T08:34:44.004ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
50992025-01-17T08:34:44.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51002025-01-17T08:34:44.007ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51012025-01-17T08:34:44.007ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51022025-01-17T08:34:44.010ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51032025-01-17T08:34:44.010ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51042025-01-17T08:34:44.014ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51052025-01-17T08:34:44.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51062025-01-17T08:34:44.016ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51072025-01-17T08:34:44.016ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51082025-01-17T08:34:44.017ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51092025-01-17T08:34:44.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51102025-01-17T08:34:44.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51112025-01-17T08:34:44.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51122025-01-17T08:34:44.051ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51132025-01-17T08:34:44.051ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51142025-01-17T08:34:44.051ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51152025-01-17T08:34:44.052ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "041bdd45-72a3-42ac-b4f4-c21f6026b173", "content-length": "372", "date": "Fri, 17 Jan 2025 08:34:44 GMT"} })
51162025-01-17T08:34:44.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51172025-01-17T08:34:44.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51182025-01-17T08:34:44.055ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 603edd29-2275-4ced-9f13-a1ccdff45ca3, lookup_type: ById(603edd29-2275-4ced-9f13-a1ccdff45ca3) }, key: a67a60de-0cac-4068-8294-f4205972bd35, lookup_type: ById(a67a60de-0cac-4068-8294-f4205972bd35) }, key: fe4e411b-6385-4535-894a-f7e7e7ac5d5f, lookup_type: ById(fe4e411b-6385-4535-894a-f7e7e7ac5d5f) } result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51192025-01-17T08:34:44.055ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51202025-01-17T08:34:44.055ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_node = ChainSuccessorSaga
51212025-01-17T08:34:44.061ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f karmic_state = WillReincarnate needs_reincarnation = false saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update
51222025-01-17T08:34:44.061ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51232025-01-17T08:34:44.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51242025-01-17T08:34:44.065ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51252025-01-17T08:34:44.065ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51262025-01-17T08:34:44.068ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51272025-01-17T08:34:44.069ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ab683310-e23e-4530-82f3-569495dd919c
51282025-01-17T08:34:44.073ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ab683310-e23e-4530-82f3-569495dd919c sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51292025-01-17T08:34:44.073ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ab683310-e23e-4530-82f3-569495dd919c
51302025-01-17T08:34:44.098ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51312025-01-17T08:34:44.098ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51322025-01-17T08:34:44.099ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a02c5870-f311-432a-80e8-d11a1973ede6", "date": "Fri, 17 Jan 2025 08:34:44 GMT"} })
51332025-01-17T08:34:44.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51342025-01-17T08:34:44.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51352025-01-17T08:34:44.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51362025-01-17T08:34:44.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51372025-01-17T08:34:44.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51382025-01-17T08:34:44.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51392025-01-17T08:34:44.108ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51402025-01-17T08:34:44.108ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51412025-01-17T08:34:44.109ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "436ac7cf-c962-4411-801f-2b86d4782e98", "date": "Fri, 17 Jan 2025 08:34:44 GMT"} })
51422025-01-17T08:34:44.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 172.689026ms iteration = 24 status = {}
51432025-01-17T08:34:44.120ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51442025-01-17T08:34:44.123ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ab683310-e23e-4530-82f3-569495dd919c saga_name = instance-update saga_result = SagaResult { saga_id: ab683310-e23e-4530-82f3-569495dd919c, saga_log: SagaLog { saga_id: ab683310-e23e-4530-82f3-569495dd919c, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("fe4e411b-6385-4535-894a-f7e7e7ac5d5f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("8dc274bd-acbb-41c1-8419-e1186e06c382")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("fe4e411b-6385-4535-894a-f7e7e7ac5d5f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("8dc274bd-acbb-41c1-8419-e1186e06c382")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("d7411c1c-fb94-4fd0-8eb2-82ab215146f7")}} }) }
51452025-01-17T08:34:44.123ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = ab683310-e23e-4530-82f3-569495dd919c instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update
51462025-01-17T08:34:44.123ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51472025-01-17T08:34:44.123ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
51482025-01-17T08:34:44.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51492025-01-17T08:34:44.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51502025-01-17T08:34:44.126ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51512025-01-17T08:34:44.126ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
51522025-01-17T08:34:44.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51532025-01-17T08:34:44.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51542025-01-17T08:34:44.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51552025-01-17T08:34:44.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51562025-01-17T08:34:44.130ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51572025-01-17T08:34:44.130ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
51582025-01-17T08:34:44.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51592025-01-17T08:34:44.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51602025-01-17T08:34:44.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51612025-01-17T08:34:44.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51622025-01-17T08:34:44.133ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51632025-01-17T08:34:44.133ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5
51642025-01-17T08:34:44.139ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update sec_id = b72586ef-ab31-4002-9c99-4f4040a5f525
51652025-01-17T08:34:44.139ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 721112f8-c819-4643-94d4-4ec3f4fffbe5 saga_name = start-instance-update saga_result = SagaResult { saga_id: 721112f8-c819-4643-94d4-4ec3f4fffbe5, saga_log: SagaLog { saga_id: 721112f8-c819-4643-94d4-4ec3f4fffbe5, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("5115ab89-96f4-40cb-9092-68be998433b8")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5115ab89-96f4-40cb-9092-68be998433b8")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("5115ab89-96f4-40cb-9092-68be998433b8"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("5115ab89-96f4-40cb-9092-68be998433b8")}} }) }
51662025-01-17T08:34:44.166ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51672025-01-17T08:34:44.166ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c79332d-5e58-47f2-a5b6-88b8cc0a6ec5", "content-length": "691", "date": "Fri, 17 Jan 2025 08:34:44 GMT"} })
51682025-01-17T08:34:44.166ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51692025-01-17T08:34:44.166ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51702025-01-17T08:34:44.166ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51712025-01-17T08:34:44.168ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 229.537286ms iteration = 24 status = {}
51722025-01-17T08:34:44.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = ed128433-898e-4766-a438-cc4add52833e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
51732025-01-17T08:34:44.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = ed128433-898e-4766-a438-cc4add52833e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
51742025-01-17T08:34:44.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = ed128433-898e-4766-a438-cc4add52833e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
51752025-01-17T08:34:44.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9ef447b-574c-4a54-b0e8-581ca1793cb1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51762025-01-17T08:34:44.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9ef447b-574c-4a54-b0e8-581ca1793cb1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51772025-01-17T08:34:44.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1748 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b9ef447b-574c-4a54-b0e8-581ca1793cb1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51782025-01-17T08:34:45.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0cde9c46-8fd0-4e28-a300-638ce290e1b3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51792025-01-17T08:34:45.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0cde9c46-8fd0-4e28-a300-638ce290e1b3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51802025-01-17T08:34:45.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0cde9c46-8fd0-4e28-a300-638ce290e1b3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51812025-01-17T08:34:46.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d877536e-1531-46bc-ba4c-3519ea967849 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51822025-01-17T08:34:46.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d877536e-1531-46bc-ba4c-3519ea967849 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51832025-01-17T08:34:46.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3046 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d877536e-1531-46bc-ba4c-3519ea967849 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51842025-01-17T08:34:47.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99b5583c-2464-431e-868f-14f8e388448d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51852025-01-17T08:34:47.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99b5583c-2464-431e-868f-14f8e388448d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51862025-01-17T08:34:47.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2883 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99b5583c-2464-431e-868f-14f8e388448d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51872025-01-17T08:34:48.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2acae2c4-2e81-4ee8-9b5f-d5076f8693a6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51882025-01-17T08:34:48.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2acae2c4-2e81-4ee8-9b5f-d5076f8693a6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51892025-01-17T08:34:48.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2acae2c4-2e81-4ee8-9b5f-d5076f8693a6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51902025-01-17T08:34:49.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27c6dd63-8f21-4404-b7e9-48c786f79caa roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51912025-01-17T08:34:49.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27c6dd63-8f21-4404-b7e9-48c786f79caa resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51922025-01-17T08:34:49.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 27c6dd63-8f21-4404-b7e9-48c786f79caa response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51932025-01-17T08:34:50.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59faa6e8-03b7-403b-b7d1-ed248951c778 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51942025-01-17T08:34:50.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59faa6e8-03b7-403b-b7d1-ed248951c778 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51952025-01-17T08:34:50.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59faa6e8-03b7-403b-b7d1-ed248951c778 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51962025-01-17T08:34:51.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213c711e-2240-4a39-9b11-f9618716de16 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51972025-01-17T08:34:51.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213c711e-2240-4a39-9b11-f9618716de16 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51982025-01-17T08:34:51.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 213c711e-2240-4a39-9b11-f9618716de16 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
51992025-01-17T08:34:51.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
52002025-01-17T08:34:51.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52012025-01-17T08:34:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52022025-01-17T08:34:51.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52032025-01-17T08:34:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52042025-01-17T08:34:51.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52052025-01-17T08:34:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52062025-01-17T08:34:51.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
52072025-01-17T08:34:51.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52082025-01-17T08:34:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52092025-01-17T08:34:51.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52102025-01-17T08:34:51.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52112025-01-17T08:34:51.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52122025-01-17T08:34:51.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52132025-01-17T08:34:51.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52142025-01-17T08:34:51.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.696187ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52152025-01-17T08:34:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
52162025-01-17T08:34:51.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52172025-01-17T08:34:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52182025-01-17T08:34:51.910ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
52192025-01-17T08:34:51.910ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.375253ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
52202025-01-17T08:34:52.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7100d75-8e90-495e-b603-59e5edc369d6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52212025-01-17T08:34:52.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7100d75-8e90-495e-b603-59e5edc369d6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52222025-01-17T08:34:52.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c7100d75-8e90-495e-b603-59e5edc369d6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52232025-01-17T08:34:53.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = e3e35a65-0fd6-4677-926b-26b1e4dd604d roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
52242025-01-17T08:34:53.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = e3e35a65-0fd6-4677-926b-26b1e4dd604d resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
52252025-01-17T08:34:53.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = e3e35a65-0fd6-4677-926b-26b1e4dd604d response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
52262025-01-17T08:34:53.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 609fbb6a-dfde-4ae2-8aec-0b365e29348f roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
52272025-01-17T08:34:53.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 609fbb6a-dfde-4ae2-8aec-0b365e29348f resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
52282025-01-17T08:34:53.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 609fbb6a-dfde-4ae2-8aec-0b365e29348f response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
52292025-01-17T08:34:53.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = e19b6ec1-f0e7-492b-9286-f0f257054817 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
52302025-01-17T08:34:53.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fb4f277d-7971-4283-9f5e-52a61ca2b54b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52312025-01-17T08:34:53.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fb4f277d-7971-4283-9f5e-52a61ca2b54b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52322025-01-17T08:34:53.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = fb4f277d-7971-4283-9f5e-52a61ca2b54b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52332025-01-17T08:34:54.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21609121-9f2f-471b-9fd0-060af3e8cfff roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52342025-01-17T08:34:54.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21609121-9f2f-471b-9fd0-060af3e8cfff resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52352025-01-17T08:34:54.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 21609121-9f2f-471b-9fd0-060af3e8cfff response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52362025-01-17T08:34:55.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 155be7bd-a3b7-4ec5-87fb-e232b7fa0b99 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52372025-01-17T08:34:55.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 155be7bd-a3b7-4ec5-87fb-e232b7fa0b99 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52382025-01-17T08:34:55.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 155be7bd-a3b7-4ec5-87fb-e232b7fa0b99 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52392025-01-17T08:34:56.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 610aa99e-ec9d-4350-9fa1-db1d27105b0d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52402025-01-17T08:34:56.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 610aa99e-ec9d-4350-9fa1-db1d27105b0d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52412025-01-17T08:34:56.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 610aa99e-ec9d-4350-9fa1-db1d27105b0d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52422025-01-17T08:34:58.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf067666-5b16-4012-b8d5-f2308766992b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52432025-01-17T08:34:58.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf067666-5b16-4012-b8d5-f2308766992b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52442025-01-17T08:34:58.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cf067666-5b16-4012-b8d5-f2308766992b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52452025-01-17T08:34:59.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f25b29ff-2ef4-4fa4-97d9-299e43bf05e7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52462025-01-17T08:34:59.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f25b29ff-2ef4-4fa4-97d9-299e43bf05e7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52472025-01-17T08:34:59.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f25b29ff-2ef4-4fa4-97d9-299e43bf05e7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52482025-01-17T08:35:00.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aa3b0817-1e6c-444d-b9a0-6812a9680453 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52492025-01-17T08:35:00.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aa3b0817-1e6c-444d-b9a0-6812a9680453 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52502025-01-17T08:35:00.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = aa3b0817-1e6c-444d-b9a0-6812a9680453 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52512025-01-17T08:35:01.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2a1d9a-fff0-4228-9fee-8e6046f3625a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52522025-01-17T08:35:01.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2a1d9a-fff0-4228-9fee-8e6046f3625a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52532025-01-17T08:35:01.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2a1d9a-fff0-4228-9fee-8e6046f3625a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52542025-01-17T08:35:01.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
52552025-01-17T08:35:01.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52562025-01-17T08:35:01.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52572025-01-17T08:35:01.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52582025-01-17T08:35:01.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52592025-01-17T08:35:01.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52602025-01-17T08:35:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52612025-01-17T08:35:01.890ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
52622025-01-17T08:35:01.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52632025-01-17T08:35:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52642025-01-17T08:35:01.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52652025-01-17T08:35:01.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52662025-01-17T08:35:01.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52672025-01-17T08:35:01.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52682025-01-17T08:35:01.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52692025-01-17T08:35:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
52702025-01-17T08:35:01.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52712025-01-17T08:35:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722025-01-17T08:35:01.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
52732025-01-17T08:35:01.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.03344ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
52742025-01-17T08:35:01.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.223696ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52752025-01-17T08:35:02.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5f8f93cc-2e5c-4030-9f71-375fd1c53035 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52762025-01-17T08:35:02.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5f8f93cc-2e5c-4030-9f71-375fd1c53035 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52772025-01-17T08:35:02.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5f8f93cc-2e5c-4030-9f71-375fd1c53035 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52782025-01-17T08:35:03.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e90fbc8e-81ed-42cb-8f90-deda8ed4dc31 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52792025-01-17T08:35:03.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e90fbc8e-81ed-42cb-8f90-deda8ed4dc31 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52802025-01-17T08:35:03.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e90fbc8e-81ed-42cb-8f90-deda8ed4dc31 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52812025-01-17T08:35:03.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 640 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = f51a673c-25f8-40da-a477-b28f1ccd8045 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
52822025-01-17T08:35:04.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 52167cb6-b0c4-43a2-bd09-91e54b1d0bee roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52832025-01-17T08:35:04.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 52167cb6-b0c4-43a2-bd09-91e54b1d0bee resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52842025-01-17T08:35:04.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 52167cb6-b0c4-43a2-bd09-91e54b1d0bee response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52852025-01-17T08:35:05.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1095b976-4355-4e94-8830-b3f25fc6bc6f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52862025-01-17T08:35:05.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1095b976-4355-4e94-8830-b3f25fc6bc6f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52872025-01-17T08:35:05.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1095b976-4355-4e94-8830-b3f25fc6bc6f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52882025-01-17T08:35:06.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 270dca3a-7dc5-4035-890c-145502caa510 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52892025-01-17T08:35:06.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 270dca3a-7dc5-4035-890c-145502caa510 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52902025-01-17T08:35:06.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 270dca3a-7dc5-4035-890c-145502caa510 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52912025-01-17T08:35:07.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 672c493e-92ae-48c0-828b-15139df9c318 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52922025-01-17T08:35:07.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 672c493e-92ae-48c0-828b-15139df9c318 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52932025-01-17T08:35:07.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 672c493e-92ae-48c0-828b-15139df9c318 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52942025-01-17T08:35:08.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3086fba5-c41a-4ad9-82a5-27312ad8b263 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52952025-01-17T08:35:08.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3086fba5-c41a-4ad9-82a5-27312ad8b263 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52962025-01-17T08:35:08.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3086fba5-c41a-4ad9-82a5-27312ad8b263 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52972025-01-17T08:35:09.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2beb0ae-85b5-4a78-b02b-6d1f7eef4f76 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52982025-01-17T08:35:09.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2beb0ae-85b5-4a78-b02b-6d1f7eef4f76 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
52992025-01-17T08:35:09.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d2beb0ae-85b5-4a78-b02b-6d1f7eef4f76 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53002025-01-17T08:35:10.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 68e5414b-8cbc-4fcc-9b2d-9951ef28fd53 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53012025-01-17T08:35:10.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 68e5414b-8cbc-4fcc-9b2d-9951ef28fd53 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53022025-01-17T08:35:10.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 68e5414b-8cbc-4fcc-9b2d-9951ef28fd53 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53032025-01-17T08:35:11.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7c4b557-4c36-4fe4-9c9a-1c6a10e88766 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53042025-01-17T08:35:11.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7c4b557-4c36-4fe4-9c9a-1c6a10e88766 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53052025-01-17T08:35:11.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d7c4b557-4c36-4fe4-9c9a-1c6a10e88766 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
53062025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
53072025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
53082025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
53092025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53102025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53112025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53122025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
53132025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53142025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
53152025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
53162025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53172025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53182025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
53192025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
53202025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53212025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53222025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
53232025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
53242025-01-17T08:35:11.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53252025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53262025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53272025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53282025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53292025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53302025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53312025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53322025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53332025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53342025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
53352025-01-17T08:35:11.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53362025-01-17T08:35:11.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53372025-01-17T08:35:11.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53382025-01-17T08:35:11.889ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.277895ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53392025-01-17T08:35:11.889ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 62538372 } })
53402025-01-17T08:35:11.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
53412025-01-17T08:35:11.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53422025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
53432025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53442025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53452025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
53462025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53472025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
53482025-01-17T08:35:11.891ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53492025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53502025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53512025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53522025-01-17T08:35:11.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53532025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53542025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53552025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53562025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53572025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53582025-01-17T08:35:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53592025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53602025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
53612025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
53622025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
53632025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53642025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53652025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
53662025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53672025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53682025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53692025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53702025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53712025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53722025-01-17T08:35:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53732025-01-17T08:35:11.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742025-01-17T08:35:11.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 69066644 } })
53752025-01-17T08:35:11.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
53762025-01-17T08:35:11.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53772025-01-17T08:35:11.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53782025-01-17T08:35:11.897ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53792025-01-17T08:35:11.897ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53802025-01-17T08:35:11.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53812025-01-17T08:35:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53822025-01-17T08:35:11.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53832025-01-17T08:35:11.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53842025-01-17T08:35:11.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53852025-01-17T08:35:11.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53862025-01-17T08:35:11.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53872025-01-17T08:35:11.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53882025-01-17T08:35:11.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53892025-01-17T08:35:11.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53902025-01-17T08:35:11.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53912025-01-17T08:35:11.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53922025-01-17T08:35:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53932025-01-17T08:35:11.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53942025-01-17T08:35:11.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53952025-01-17T08:35:11.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2021, tv_nsec: 78840732 } })
53962025-01-17T08:35:11.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53972025-01-17T08:35:11.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
53982025-01-17T08:35:11.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53992025-01-17T08:35:11.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54002025-01-17T08:35:11.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54012025-01-17T08:35:11.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54022025-01-17T08:35:11.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54032025-01-17T08:35:11.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042025-01-17T08:35:11.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54052025-01-17T08:35:11.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54062025-01-17T08:35:11.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54072025-01-17T08:35:11.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54082025-01-17T08:35:11.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54092025-01-17T08:35:11.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54102025-01-17T08:35:11.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54112025-01-17T08:35:11.933ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54122025-01-17T08:35:11.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54132025-01-17T08:35:11.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.308857ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
54142025-01-17T08:35:11.941ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54152025-01-17T08:35:11.941ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54162025-01-17T08:35:11.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54172025-01-17T08:35:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54182025-01-17T08:35:11.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192025-01-17T08:35:11.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54202025-01-17T08:35:11.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54212025-01-17T08:35:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54222025-01-17T08:35:11.944ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54232025-01-17T08:35:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54242025-01-17T08:35:11.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54252025-01-17T08:35:11.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54262025-01-17T08:35:11.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54272025-01-17T08:35:11.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54282025-01-17T08:35:11.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292025-01-17T08:35:11.948ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54302025-01-17T08:35:11.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54312025-01-17T08:35:11.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.135244ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
54322025-01-17T08:35:11.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
54332025-01-17T08:35:11.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54342025-01-17T08:35:11.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54352025-01-17T08:35:11.952ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54362025-01-17T08:35:11.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.491757ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54372025-01-17T08:35:11.954ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54382025-01-17T08:35:11.954ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.889567ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
54392025-01-17T08:35:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
54402025-01-17T08:35:11.955ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54412025-01-17T08:35:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54422025-01-17T08:35:11.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
54432025-01-17T08:35:11.972ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54442025-01-17T08:35:11.972ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9348abfd-9227-4476-9788-a4f045d0519c", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
54452025-01-17T08:35:11.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54462025-01-17T08:35:11.972ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
54472025-01-17T08:35:11.972ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.919978ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
54482025-01-17T08:35:11.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54492025-01-17T08:35:11.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54502025-01-17T08:35:11.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54512025-01-17T08:35:11.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.898161ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54522025-01-17T08:35:11.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54532025-01-17T08:35:11.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54542025-01-17T08:35:11.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54552025-01-17T08:35:11.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
54562025-01-17T08:35:11.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54572025-01-17T08:35:11.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54582025-01-17T08:35:11.983ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.732654ms iteration = 24 status = 0
54592025-01-17T08:35:11.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
54602025-01-17T08:35:11.987ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54612025-01-17T08:35:11.987ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54622025-01-17T08:35:11.987ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54632025-01-17T08:35:11.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.124211ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54642025-01-17T08:35:11.987ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fe09eea-8bec-42d5-b150-d5a12023d508", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
54652025-01-17T08:35:11.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54662025-01-17T08:35:11.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.112035ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54672025-01-17T08:35:11.989ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
54682025-01-17T08:35:11.989ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 103.427298ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
54692025-01-17T08:35:11.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54702025-01-17T08:35:11.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54712025-01-17T08:35:11.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54722025-01-17T08:35:12.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
54732025-01-17T08:35:12.011ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54742025-01-17T08:35:12.012ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "383be8b7-006d-4de3-927c-5feafb6f02fc", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
54752025-01-17T08:35:12.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54762025-01-17T08:35:12.014ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
54772025-01-17T08:35:12.018ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.888632ms iteration = 27 status = {"physical_disks_added":0}
54782025-01-17T08:35:12.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.491681ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
54792025-01-17T08:35:12.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54802025-01-17T08:35:12.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54812025-01-17T08:35:12.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822025-01-17T08:35:12.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54832025-01-17T08:35:12.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54842025-01-17T08:35:12.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54852025-01-17T08:35:12.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54862025-01-17T08:35:12.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54872025-01-17T08:35:12.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54882025-01-17T08:35:12.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54892025-01-17T08:35:12.135ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54902025-01-17T08:35:12.135ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54912025-01-17T08:35:12.136ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3422f56b-b9ea-4285-ae04-5f8b5ad829d4", "content-length": "372", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
54922025-01-17T08:35:12.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54932025-01-17T08:35:12.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54942025-01-17T08:35:12.186ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54952025-01-17T08:35:12.186ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54962025-01-17T08:35:12.186ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d2b87ae2-62d5-4968-9b6d-9b713b410bd7", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
54972025-01-17T08:35:12.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54982025-01-17T08:35:12.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54992025-01-17T08:35:12.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55002025-01-17T08:35:12.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55012025-01-17T08:35:12.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55022025-01-17T08:35:12.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55032025-01-17T08:35:12.196ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55042025-01-17T08:35:12.196ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55052025-01-17T08:35:12.197ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c8984959-09f9-49c6-a436-0c593ed5111b", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
55062025-01-17T08:35:12.199ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 307.739505ms iteration = 25 status = {}
55072025-01-17T08:35:12.237ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55082025-01-17T08:35:12.237ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba02daf7-337d-4ebf-b4b7-9f99cb4cc3b6", "content-length": "691", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
55092025-01-17T08:35:12.237ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55102025-01-17T08:35:12.237ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55112025-01-17T08:35:12.237ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55122025-01-17T08:35:12.239ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.268375ms iteration = 25 status = {}
55132025-01-17T08:35:12.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.585235ms iteration = 24 status = {}
55142025-01-17T08:35:12.275ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55152025-01-17T08:35:12.275ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0223fcbc-da89-4f38-8635-053967be03d4", "content-length": "2", "date": "Fri, 17 Jan 2025 08:35:12 GMT"} })
55162025-01-17T08:35:12.277ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55172025-01-17T08:35:12.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55182025-01-17T08:35:12.279ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.958647ms iteration = 24 status = null
55192025-01-17T08:35:12.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9365a49a-dac9-4142-a824-595eaf6af095 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55202025-01-17T08:35:12.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9365a49a-dac9-4142-a824-595eaf6af095 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55212025-01-17T08:35:12.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9365a49a-dac9-4142-a824-595eaf6af095 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55222025-01-17T08:35:12.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55232025-01-17T08:35:12.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55242025-01-17T08:35:12.344ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
55252025-01-17T08:35:12.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55262025-01-17T08:35:12.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55272025-01-17T08:35:12.351ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55282025-01-17T08:35:12.351ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "697a0b25-8273-4904-b655-7e084256541a", "content-length": "134", "date": "Fri, 17 Jan 2025 08:35:12 GMT"} })
55292025-01-17T08:35:12.351ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55302025-01-17T08:35:12.351ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
55312025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55322025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55332025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55342025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55352025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55362025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55372025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55382025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55392025-01-17T08:35:12.352ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
55402025-01-17T08:35:12.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55412025-01-17T08:35:12.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55422025-01-17T08:35:12.353ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55432025-01-17T08:35:12.353ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "80f6579e-3e85-4f5a-80c0-5f7d39fff820", "content-length": "2", "date": "Fri, 17 Jan 2025 08:35:12 GMT"} })
55442025-01-17T08:35:12.353ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55452025-01-17T08:35:12.353ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c90d281-98fd-41dd-bbe7-790d23ef9559", "content-length": "52", "date": "Fri, 17 Jan 2025 08:35:12 GMT"} })
55462025-01-17T08:35:12.353ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
55472025-01-17T08:35:12.353ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55482025-01-17T08:35:12.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "80037f3a-dd94-4c43-af18-563fb268f38a", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
55492025-01-17T08:35:12.443ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
55502025-01-17T08:35:12.443ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55512025-01-17T08:35:12.446ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d311b258-52bf-4e72-9d2d-d0fadf678419", "content-length": "682", "date": "Fri, 17 Jan 2025 08:35:11 GMT"} })
55522025-01-17T08:35:12.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55532025-01-17T08:35:12.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55542025-01-17T08:35:12.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55552025-01-17T08:35:12.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55562025-01-17T08:35:12.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55572025-01-17T08:35:12.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55582025-01-17T08:35:12.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55592025-01-17T08:35:12.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55602025-01-17T08:35:12.461ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 575.569034ms iteration = 24 status = {}
55612025-01-17T08:35:13.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 215bae79-350b-417a-a316-807e7a6bfc0d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55622025-01-17T08:35:13.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 215bae79-350b-417a-a316-807e7a6bfc0d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55632025-01-17T08:35:13.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 215bae79-350b-417a-a316-807e7a6bfc0d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55642025-01-17T08:35:13.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 6c9ed8cf-5fee-4717-926a-131d88ace946 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
55652025-01-17T08:35:14.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdadd4ae-3991-4c42-9cfe-8757a6700d80 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55662025-01-17T08:35:14.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdadd4ae-3991-4c42-9cfe-8757a6700d80 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55672025-01-17T08:35:14.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bdadd4ae-3991-4c42-9cfe-8757a6700d80 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55682025-01-17T08:35:14.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d8c77806-1dab-4c24-aa3d-56a3a2ae7b19 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
55692025-01-17T08:35:14.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d8c77806-1dab-4c24-aa3d-56a3a2ae7b19 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
55702025-01-17T08:35:14.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3042 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = d8c77806-1dab-4c24-aa3d-56a3a2ae7b19 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
55712025-01-17T08:35:15.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2cbc9431-4bea-425a-b0c1-4875254ceacf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55722025-01-17T08:35:15.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2cbc9431-4bea-425a-b0c1-4875254ceacf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55732025-01-17T08:35:15.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2cbc9431-4bea-425a-b0c1-4875254ceacf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55742025-01-17T08:35:16.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9a0d42f-f6bc-414a-8c86-d8d018d8a090 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55752025-01-17T08:35:16.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9a0d42f-f6bc-414a-8c86-d8d018d8a090 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55762025-01-17T08:35:16.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d9a0d42f-f6bc-414a-8c86-d8d018d8a090 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55772025-01-17T08:35:17.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28ee1fb9-f323-4648-af3f-310fd27773a2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55782025-01-17T08:35:17.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28ee1fb9-f323-4648-af3f-310fd27773a2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55792025-01-17T08:35:17.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 28ee1fb9-f323-4648-af3f-310fd27773a2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55802025-01-17T08:35:18.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2d64627a-4c4b-462c-a497-cf28ba9ff25d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55812025-01-17T08:35:18.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2d64627a-4c4b-462c-a497-cf28ba9ff25d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55822025-01-17T08:35:18.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2d64627a-4c4b-462c-a497-cf28ba9ff25d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55832025-01-17T08:35:19.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 207796c9-76b3-4e4c-ad29-12443b0088e5 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55842025-01-17T08:35:19.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 207796c9-76b3-4e4c-ad29-12443b0088e5 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55852025-01-17T08:35:19.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 207796c9-76b3-4e4c-ad29-12443b0088e5 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55862025-01-17T08:35:20.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 645aa89b-215f-4ebd-a857-f05c5a873e7e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55872025-01-17T08:35:20.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 645aa89b-215f-4ebd-a857-f05c5a873e7e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55882025-01-17T08:35:20.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 645aa89b-215f-4ebd-a857-f05c5a873e7e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55892025-01-17T08:35:21.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 173b10ca-0ea0-4023-8736-a6070261a4ee roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55902025-01-17T08:35:21.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 173b10ca-0ea0-4023-8736-a6070261a4ee resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55912025-01-17T08:35:21.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 173b10ca-0ea0-4023-8736-a6070261a4ee response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
55922025-01-17T08:35:21.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
55932025-01-17T08:35:21.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55942025-01-17T08:35:21.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55952025-01-17T08:35:21.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55962025-01-17T08:35:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55972025-01-17T08:35:21.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55982025-01-17T08:35:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55992025-01-17T08:35:21.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
56002025-01-17T08:35:21.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56012025-01-17T08:35:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56022025-01-17T08:35:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56032025-01-17T08:35:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56042025-01-17T08:35:21.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56052025-01-17T08:35:21.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56062025-01-17T08:35:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56072025-01-17T08:35:21.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
56082025-01-17T08:35:21.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56092025-01-17T08:35:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56102025-01-17T08:35:21.907ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
56112025-01-17T08:35:21.907ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.771852ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
56122025-01-17T08:35:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.765681ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56132025-01-17T08:35:22.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 315779d4-5089-4a80-9ab5-45fda0b6b49e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56142025-01-17T08:35:22.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 315779d4-5089-4a80-9ab5-45fda0b6b49e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56152025-01-17T08:35:22.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 315779d4-5089-4a80-9ab5-45fda0b6b49e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56162025-01-17T08:35:23.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 7a5fa5f8-d32f-421a-a373-37384f1112f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
56172025-01-17T08:35:23.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 7a5fa5f8-d32f-421a-a373-37384f1112f4 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
56182025-01-17T08:35:23.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2959 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 7a5fa5f8-d32f-421a-a373-37384f1112f4 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
56192025-01-17T08:35:23.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 2ebf9702-8673-4f1f-8d9d-97703e7e4fca roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
56202025-01-17T08:35:23.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 2ebf9702-8673-4f1f-8d9d-97703e7e4fca resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
56212025-01-17T08:35:23.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 2ebf9702-8673-4f1f-8d9d-97703e7e4fca response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
56222025-01-17T08:35:23.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 638 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = cde198f0-5ae5-44bd-b8e4-00b57593ca7b response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
56232025-01-17T08:35:23.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ece0e8b2-f2d3-4bc3-94ce-af6ae890aff8 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56242025-01-17T08:35:23.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ece0e8b2-f2d3-4bc3-94ce-af6ae890aff8 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56252025-01-17T08:35:23.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ece0e8b2-f2d3-4bc3-94ce-af6ae890aff8 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56262025-01-17T08:35:24.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 230060b9-a369-49bc-b15c-bcf0c0a6e763 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56272025-01-17T08:35:24.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 230060b9-a369-49bc-b15c-bcf0c0a6e763 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56282025-01-17T08:35:24.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 230060b9-a369-49bc-b15c-bcf0c0a6e763 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56292025-01-17T08:35:25.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d20793e0-e6b3-4b56-834b-765e7a69a5c1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56302025-01-17T08:35:25.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d20793e0-e6b3-4b56-834b-765e7a69a5c1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56312025-01-17T08:35:25.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d20793e0-e6b3-4b56-834b-765e7a69a5c1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56322025-01-17T08:35:26.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9289dade-3f96-41c6-9965-e2670b008569 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56332025-01-17T08:35:26.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9289dade-3f96-41c6-9965-e2670b008569 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56342025-01-17T08:35:26.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9289dade-3f96-41c6-9965-e2670b008569 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56352025-01-17T08:35:27.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5dc71ab-6c5e-41fe-848d-3dd6d6600adf roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56362025-01-17T08:35:27.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5dc71ab-6c5e-41fe-848d-3dd6d6600adf resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56372025-01-17T08:35:27.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2894 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e5dc71ab-6c5e-41fe-848d-3dd6d6600adf response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56382025-01-17T08:35:28.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d5e3ce5-d072-48c8-83d7-9c10b8c8a2c2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56392025-01-17T08:35:28.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d5e3ce5-d072-48c8-83d7-9c10b8c8a2c2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56402025-01-17T08:35:28.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2669 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6d5e3ce5-d072-48c8-83d7-9c10b8c8a2c2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56412025-01-17T08:35:29.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6759f638-75ba-4def-b339-7251fe69821e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56422025-01-17T08:35:29.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6759f638-75ba-4def-b339-7251fe69821e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56432025-01-17T08:35:29.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 6759f638-75ba-4def-b339-7251fe69821e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56442025-01-17T08:35:30.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73194738-b787-4770-93ea-73dbeb31663f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56452025-01-17T08:35:30.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73194738-b787-4770-93ea-73dbeb31663f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56462025-01-17T08:35:30.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 73194738-b787-4770-93ea-73dbeb31663f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56472025-01-17T08:35:31.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1d0efd4c-6d33-49fc-a9d5-18e90b98579b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56482025-01-17T08:35:31.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1d0efd4c-6d33-49fc-a9d5-18e90b98579b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56492025-01-17T08:35:31.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1d0efd4c-6d33-49fc-a9d5-18e90b98579b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56502025-01-17T08:35:31.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
56512025-01-17T08:35:31.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56522025-01-17T08:35:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56532025-01-17T08:35:31.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56542025-01-17T08:35:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56552025-01-17T08:35:31.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56562025-01-17T08:35:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56572025-01-17T08:35:31.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
56582025-01-17T08:35:31.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56592025-01-17T08:35:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56602025-01-17T08:35:31.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56612025-01-17T08:35:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56622025-01-17T08:35:31.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56632025-01-17T08:35:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56642025-01-17T08:35:31.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652025-01-17T08:35:31.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.650259ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56662025-01-17T08:35:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
56672025-01-17T08:35:31.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682025-01-17T08:35:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692025-01-17T08:35:31.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
56702025-01-17T08:35:31.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.964938ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
56712025-01-17T08:35:32.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f71e508-c738-4742-ab10-acd3255b9747 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56722025-01-17T08:35:32.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f71e508-c738-4742-ab10-acd3255b9747 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56732025-01-17T08:35:32.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f71e508-c738-4742-ab10-acd3255b9747 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56742025-01-17T08:35:33.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 610 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = db86e983-f2e9-4fd6-bcae-65af71a44829 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
56752025-01-17T08:35:33.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 79564ef9-3240-4d48-88e5-746524d31ee2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56762025-01-17T08:35:33.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 79564ef9-3240-4d48-88e5-746524d31ee2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56772025-01-17T08:35:33.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 79564ef9-3240-4d48-88e5-746524d31ee2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56782025-01-17T08:35:34.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9b2e6414-03ed-4875-b824-e43bf528b5fd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56792025-01-17T08:35:34.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9b2e6414-03ed-4875-b824-e43bf528b5fd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56802025-01-17T08:35:34.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9b2e6414-03ed-4875-b824-e43bf528b5fd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56812025-01-17T08:35:35.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3923dbfa-4c18-47b7-9fab-a3db4a84a237 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56822025-01-17T08:35:35.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3923dbfa-4c18-47b7-9fab-a3db4a84a237 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56832025-01-17T08:35:35.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3923dbfa-4c18-47b7-9fab-a3db4a84a237 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56842025-01-17T08:35:36.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4a096744-f379-4f9b-9b90-49faaf0ce43f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56852025-01-17T08:35:36.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4a096744-f379-4f9b-9b90-49faaf0ce43f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56862025-01-17T08:35:36.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4a096744-f379-4f9b-9b90-49faaf0ce43f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56872025-01-17T08:35:37.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 337c81a9-5bfb-4209-b32d-3a2ffdbb551f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56882025-01-17T08:35:37.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 337c81a9-5bfb-4209-b32d-3a2ffdbb551f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56892025-01-17T08:35:37.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 337c81a9-5bfb-4209-b32d-3a2ffdbb551f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56902025-01-17T08:35:38.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e069250-0fb5-45b8-ba3f-c470ce4c0a3a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56912025-01-17T08:35:38.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e069250-0fb5-45b8-ba3f-c470ce4c0a3a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56922025-01-17T08:35:38.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e069250-0fb5-45b8-ba3f-c470ce4c0a3a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56932025-01-17T08:35:39.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 81a4c03a-27f5-4a93-894d-f2a52202e861 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56942025-01-17T08:35:39.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 81a4c03a-27f5-4a93-894d-f2a52202e861 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56952025-01-17T08:35:39.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 81a4c03a-27f5-4a93-894d-f2a52202e861 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56962025-01-17T08:35:40.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9cab93e9-6bff-43c3-8620-327240bdb003 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56972025-01-17T08:35:40.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9cab93e9-6bff-43c3-8620-327240bdb003 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56982025-01-17T08:35:40.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9cab93e9-6bff-43c3-8620-327240bdb003 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
56992025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
57002025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
57012025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57022025-01-17T08:35:41.885ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:25:41.885204923 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57032025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57042025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57052025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
57062025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
57072025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
57092025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57102025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57112025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
57122025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57132025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
57142025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
57152025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57162025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
57172025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57182025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
57192025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
57202025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
57212025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57222025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57232025-01-17T08:35:41.885ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57242025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57252025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
57262025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
57272025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
57282025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
57292025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
57302025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57312025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57322025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
57332025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57342025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
57352025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57362025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
57372025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57382025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
57392025-01-17T08:35:41.885ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
57402025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.461\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
57412025-01-17T08:35:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57422025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57432025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57442025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57452025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57462025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57472025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57482025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57492025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57502025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57512025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
57522025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57532025-01-17T08:35:41.886ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 59374827 } })
57542025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57552025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57562025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57572025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57582025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57592025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57602025-01-17T08:35:41.886ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 59503028 } })
57612025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57622025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57632025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
57642025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57652025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.27328ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
57662025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57672025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57682025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
57692025-01-17T08:35:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.464632ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
57702025-01-17T08:35:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57712025-01-17T08:35:41.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57722025-01-17T08:35:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57732025-01-17T08:35:41.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57742025-01-17T08:35:41.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57752025-01-17T08:35:41.889ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:25:41.885204923 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57762025-01-17T08:35:41.889ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.80667ms iteration = 13 status = {"expiration":"2025-01-17T08:25:41.885204923Z","pruned":[]}
57772025-01-17T08:35:41.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57782025-01-17T08:35:41.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57792025-01-17T08:35:41.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57802025-01-17T08:35:41.890ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.01228ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57812025-01-17T08:35:41.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822025-01-17T08:35:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57832025-01-17T08:35:41.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57842025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
57852025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57862025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
57872025-01-17T08:35:41.892ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57882025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57892025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57902025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
57912025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57922025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57932025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
57942025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57952025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57962025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57972025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57982025-01-17T08:35:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57992025-01-17T08:35:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58002025-01-17T08:35:41.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58012025-01-17T08:35:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58022025-01-17T08:35:41.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58032025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58042025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
58052025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
58062025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58072025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58082025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
58092025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
58102025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58112025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58122025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
58132025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58142025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
58152025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58162025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58172025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58182025-01-17T08:35:41.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 68488490 } })
58192025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58202025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58212025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58222025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58232025-01-17T08:35:41.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
58242025-01-17T08:35:41.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58262025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58272025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58282025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58292025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58302025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58312025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58322025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58332025-01-17T08:35:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58342025-01-17T08:35:41.899ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 72289620 } })
58352025-01-17T08:35:41.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58362025-01-17T08:35:41.899ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
58372025-01-17T08:35:41.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58382025-01-17T08:35:41.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58392025-01-17T08:35:41.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58402025-01-17T08:35:41.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412025-01-17T08:35:41.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58422025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58432025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58442025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58452025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58462025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58472025-01-17T08:35:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58482025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58492025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58502025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58512025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58522025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58532025-01-17T08:35:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58542025-01-17T08:35:41.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58552025-01-17T08:35:41.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562025-01-17T08:35:41.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58572025-01-17T08:35:41.907ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58582025-01-17T08:35:41.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58592025-01-17T08:35:41.907ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58602025-01-17T08:35:41.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58612025-01-17T08:35:41.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622025-01-17T08:35:41.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58632025-01-17T08:35:41.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58642025-01-17T08:35:41.909ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58652025-01-17T08:35:41.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58662025-01-17T08:35:41.910ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672025-01-17T08:35:41.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58682025-01-17T08:35:41.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58692025-01-17T08:35:41.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58702025-01-17T08:35:41.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58712025-01-17T08:35:41.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58722025-01-17T08:35:41.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58732025-01-17T08:35:41.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58742025-01-17T08:35:41.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58752025-01-17T08:35:41.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.113139ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
58762025-01-17T08:35:41.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58772025-01-17T08:35:41.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58782025-01-17T08:35:41.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58792025-01-17T08:35:41.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58802025-01-17T08:35:41.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58812025-01-17T08:35:41.917ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58822025-01-17T08:35:41.917ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58832025-01-17T08:35:41.917ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 22.415458ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58842025-01-17T08:35:41.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 23.559417ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
58852025-01-17T08:35:41.918ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.549167ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
58862025-01-17T08:35:41.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58872025-01-17T08:35:41.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58882025-01-17T08:35:41.921ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2051, tv_nsec: 94739877 } })
58892025-01-17T08:35:41.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
58902025-01-17T08:35:41.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58912025-01-17T08:35:41.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58922025-01-17T08:35:41.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58932025-01-17T08:35:41.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
58942025-01-17T08:35:41.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58952025-01-17T08:35:41.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58962025-01-17T08:35:41.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972025-01-17T08:35:41.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982025-01-17T08:35:41.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58992025-01-17T08:35:41.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59002025-01-17T08:35:41.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59012025-01-17T08:35:41.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59022025-01-17T08:35:41.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59032025-01-17T08:35:41.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59042025-01-17T08:35:41.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4ef8c405-785b-4094-9486-2cc5acfdf56b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
59052025-01-17T08:35:41.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4ef8c405-785b-4094-9486-2cc5acfdf56b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
59062025-01-17T08:35:41.944ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59072025-01-17T08:35:41.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59082025-01-17T08:35:41.946ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
59092025-01-17T08:35:41.946ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.618458ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
59102025-01-17T08:35:41.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12966 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4ef8c405-785b-4094-9486-2cc5acfdf56b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
59112025-01-17T08:35:41.960ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59122025-01-17T08:35:41.960ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59132025-01-17T08:35:41.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59142025-01-17T08:35:41.960ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59152025-01-17T08:35:41.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59162025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59172025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59182025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59192025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59202025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59212025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59222025-01-17T08:35:41.964ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59232025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59242025-01-17T08:35:41.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59252025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59262025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59272025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59282025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59292025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59302025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59312025-01-17T08:35:41.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59322025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.140557ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59332025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59342025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59352025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59362025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59372025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.107282ms iteration = 6 status = {"nsuccess":5}
59382025-01-17T08:35:41.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59392025-01-17T08:35:41.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59402025-01-17T08:35:41.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59412025-01-17T08:35:41.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59422025-01-17T08:35:41.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59432025-01-17T08:35:41.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59442025-01-17T08:35:41.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59452025-01-17T08:35:41.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59462025-01-17T08:35:41.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59472025-01-17T08:35:41.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59482025-01-17T08:35:41.972ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59492025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59502025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59512025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59522025-01-17T08:35:41.973ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59532025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.389309ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59542025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
59552025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59562025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59572025-01-17T08:35:41.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59582025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59592025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59602025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59612025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59622025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59632025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59642025-01-17T08:35:41.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.826912ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59652025-01-17T08:35:41.976ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662025-01-17T08:35:41.976ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.00169ms iteration = 25 status = 0
59672025-01-17T08:35:41.977ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59682025-01-17T08:35:41.977ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59692025-01-17T08:35:41.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59702025-01-17T08:35:41.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59712025-01-17T08:35:41.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59722025-01-17T08:35:41.979ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59732025-01-17T08:35:41.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59742025-01-17T08:35:41.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59752025-01-17T08:35:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59762025-01-17T08:35:41.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59772025-01-17T08:35:41.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59782025-01-17T08:35:41.987ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59792025-01-17T08:35:41.987ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.769457ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59802025-01-17T08:35:41.988ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59812025-01-17T08:35:41.988ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59822025-01-17T08:35:41.988ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
59832025-01-17T08:35:41.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 102.925664ms iteration = 13 status = {"generation":1}
59842025-01-17T08:35:41.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.570733ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59852025-01-17T08:35:41.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59862025-01-17T08:35:41.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59872025-01-17T08:35:41.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59882025-01-17T08:35:41.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59892025-01-17T08:35:41.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59902025-01-17T08:35:41.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59912025-01-17T08:35:41.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59922025-01-17T08:35:41.997ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59932025-01-17T08:35:41.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59942025-01-17T08:35:41.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59952025-01-17T08:35:42.003ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59962025-01-17T08:35:42.003ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
59972025-01-17T08:35:42.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59982025-01-17T08:35:42.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59992025-01-17T08:35:42.006ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60002025-01-17T08:35:42.006ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60012025-01-17T08:35:42.006ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.202074ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60022025-01-17T08:35:42.016ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
60032025-01-17T08:35:42.016ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.730355ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
60042025-01-17T08:35:42.022ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60052025-01-17T08:35:42.029ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
60062025-01-17T08:35:42.029ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 143.940968ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60072025-01-17T08:35:42.037ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
60082025-01-17T08:35:42.037ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60092025-01-17T08:35:42.037ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8875d69-3d9e-4f6e-97c0-d8e29b9cd85e", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
60102025-01-17T08:35:42.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60112025-01-17T08:35:42.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60122025-01-17T08:35:42.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60132025-01-17T08:35:42.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60142025-01-17T08:35:42.050ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.720673ms iteration = 28 status = {"physical_disks_added":0}
60152025-01-17T08:35:42.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
60162025-01-17T08:35:42.059ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60172025-01-17T08:35:42.059ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "826bff98-fc3f-412d-af18-2f3d57534247", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
60182025-01-17T08:35:42.059ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60192025-01-17T08:35:42.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60202025-01-17T08:35:42.083ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60212025-01-17T08:35:42.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
60222025-01-17T08:35:42.096ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60232025-01-17T08:35:42.097ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "002c5cbf-f9ac-48a3-9e56-8df2989e4fa8", "content-length": "26", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
60242025-01-17T08:35:42.097ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60252025-01-17T08:35:42.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
60262025-01-17T08:35:42.218ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60272025-01-17T08:35:42.219ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f12f6eb8-0a81-4115-bbd6-bfed9d37177e", "content-length": "2", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
60282025-01-17T08:35:42.220ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60292025-01-17T08:35:42.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60302025-01-17T08:35:42.293ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60312025-01-17T08:35:42.293ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60322025-01-17T08:35:42.293ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd05ef51-f98a-44fa-920e-bfba896e52a9", "content-length": "372", "date": "Fri, 17 Jan 2025 08:35:41 GMT"} })
60332025-01-17T08:35:42.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60342025-01-17T08:35:42.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60352025-01-17T08:35:42.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362025-01-17T08:35:42.297ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 411.837308ms iteration = 25 status = null
60372025-01-17T08:35:42.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60382025-01-17T08:35:42.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60392025-01-17T08:35:42.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60402025-01-17T08:35:42.301ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
60412025-01-17T08:35:42.301ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60422025-01-17T08:35:42.301ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
60432025-01-17T08:35:42.301ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 416.333734ms iteration = 13 status = {"generation":2}
60442025-01-17T08:35:42.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60452025-01-17T08:35:42.322ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7099f9dd-110d-496d-b767-0bd6af48ce91", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60462025-01-17T08:35:42.322ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60472025-01-17T08:35:42.324ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "48408cdb-7b8c-4afd-a59b-196c0278f63f", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60482025-01-17T08:35:42.324ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60492025-01-17T08:35:42.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 433.892134ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60502025-01-17T08:35:42.329ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
60512025-01-17T08:35:42.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522025-01-17T08:35:42.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 443.917792ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60532025-01-17T08:35:42.329ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60542025-01-17T08:35:42.329ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 437.856535ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60552025-01-17T08:35:42.330ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60562025-01-17T08:35:42.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60572025-01-17T08:35:42.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60582025-01-17T08:35:42.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60592025-01-17T08:35:42.332ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.491643ms iteration = 25 status = {}
60602025-01-17T08:35:42.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612025-01-17T08:35:42.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60622025-01-17T08:35:42.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60632025-01-17T08:35:42.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60642025-01-17T08:35:42.344ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60652025-01-17T08:35:42.344ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60662025-01-17T08:35:42.344ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "afc49f90-adec-4465-a161-3ca0b84ffa41", "date": "Fri, 17 Jan 2025 08:35:41 GMT"} })
60672025-01-17T08:35:42.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60682025-01-17T08:35:42.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60692025-01-17T08:35:42.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60702025-01-17T08:35:42.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60712025-01-17T08:35:42.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60722025-01-17T08:35:42.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60732025-01-17T08:35:42.353ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60742025-01-17T08:35:42.353ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60752025-01-17T08:35:42.353ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a72a9505-9cc0-4c77-87cb-981d318dcadf", "date": "Fri, 17 Jan 2025 08:35:41 GMT"} })
60762025-01-17T08:35:42.355ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 463.130865ms iteration = 26 status = {}
60772025-01-17T08:35:42.392ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60782025-01-17T08:35:42.393ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0a181e12-b9e5-4b67-8f0c-e91ac7ed9b79", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60792025-01-17T08:35:42.393ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60802025-01-17T08:35:42.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d1fdaabb-47d4-4762-9cbb-83d183755de7", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60812025-01-17T08:35:42.394ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60822025-01-17T08:35:42.396ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1bddc5ec-f6ba-4d4d-bdf1-9616ffd40bc6", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60832025-01-17T08:35:42.396ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60842025-01-17T08:35:42.398ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60852025-01-17T08:35:42.398ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.523493ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60862025-01-17T08:35:42.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60872025-01-17T08:35:42.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60882025-01-17T08:35:42.423ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
60892025-01-17T08:35:42.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60902025-01-17T08:35:42.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60912025-01-17T08:35:42.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60922025-01-17T08:35:42.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77df69fa-00fd-4365-ba5e-71a3965047b3", "content-length": "134", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
60932025-01-17T08:35:42.433ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60942025-01-17T08:35:42.433ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
60952025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60962025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60972025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60982025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60992025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61002025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61012025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61022025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61032025-01-17T08:35:42.434ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
61042025-01-17T08:35:42.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61052025-01-17T08:35:42.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61062025-01-17T08:35:42.439ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61072025-01-17T08:35:42.439ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad588bb9-f137-47b4-b302-fc81dcfc56d0", "content-length": "691", "date": "Fri, 17 Jan 2025 08:35:41 GMT"} })
61082025-01-17T08:35:42.439ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61092025-01-17T08:35:42.439ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61102025-01-17T08:35:42.439ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61112025-01-17T08:35:42.440ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61122025-01-17T08:35:42.440ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b4e0596-f658-4362-9843-091f32d45948", "content-length": "2", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
61132025-01-17T08:35:42.440ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61142025-01-17T08:35:42.440ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e1adc52-a171-4f7c-a88e-68fe21563a22", "content-length": "52", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
61152025-01-17T08:35:42.440ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
61162025-01-17T08:35:42.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61172025-01-17T08:35:42.440ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 555.465935ms iteration = 26 status = {}
61182025-01-17T08:35:42.533ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6148b5a-3754-4f2d-a8a6-580f4785ce48", "date": "Fri, 17 Jan 2025 08:35:41 GMT"} })
61192025-01-17T08:35:42.533ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
61202025-01-17T08:35:42.533ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61212025-01-17T08:35:42.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "12d57ffa-3027-4593-a428-8ed6cd4478b9", "content-length": "682", "date": "Fri, 17 Jan 2025 08:35:42 GMT"} })
61222025-01-17T08:35:42.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61232025-01-17T08:35:42.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61242025-01-17T08:35:42.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61252025-01-17T08:35:42.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61262025-01-17T08:35:42.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61272025-01-17T08:35:42.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61282025-01-17T08:35:42.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61292025-01-17T08:35:42.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61302025-01-17T08:35:42.549ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 664.196286ms iteration = 25 status = {}
61312025-01-17T08:35:42.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b3f65f4-098a-40ab-b7cf-2533be87b39a roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61322025-01-17T08:35:42.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b3f65f4-098a-40ab-b7cf-2533be87b39a resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61332025-01-17T08:35:42.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2496 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b3f65f4-098a-40ab-b7cf-2533be87b39a response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61342025-01-17T08:35:43.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = b37f09ea-353f-474b-a599-2b0c2bc7cc2b response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
61352025-01-17T08:35:43.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 85325d35-2c9d-44b2-b7eb-4d1ec7d93399 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61362025-01-17T08:35:43.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 85325d35-2c9d-44b2-b7eb-4d1ec7d93399 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61372025-01-17T08:35:43.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 85325d35-2c9d-44b2-b7eb-4d1ec7d93399 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61382025-01-17T08:35:44.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = fde3b83c-4b87-4375-b051-643ac5b93617 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
61392025-01-17T08:35:44.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = fde3b83c-4b87-4375-b051-643ac5b93617 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
61402025-01-17T08:35:44.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3673 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = fde3b83c-4b87-4375-b051-643ac5b93617 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
61412025-01-17T08:35:45.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8c66745a-28ee-4ea8-a902-12d353f52db6 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61422025-01-17T08:35:45.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8c66745a-28ee-4ea8-a902-12d353f52db6 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61432025-01-17T08:35:45.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8c66745a-28ee-4ea8-a902-12d353f52db6 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61442025-01-17T08:35:46.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a07eb2cf-d88a-49d1-89a0-b9dcdb4ffd18 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61452025-01-17T08:35:46.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a07eb2cf-d88a-49d1-89a0-b9dcdb4ffd18 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61462025-01-17T08:35:46.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2737 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a07eb2cf-d88a-49d1-89a0-b9dcdb4ffd18 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61472025-01-17T08:35:47.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42ee773-2f49-4e7f-941c-4fa75ec4fcda roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61482025-01-17T08:35:47.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42ee773-2f49-4e7f-941c-4fa75ec4fcda resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61492025-01-17T08:35:47.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2817 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42ee773-2f49-4e7f-941c-4fa75ec4fcda response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61502025-01-17T08:35:48.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc77d346-a87f-4e09-8c3f-113f47597eb3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61512025-01-17T08:35:48.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc77d346-a87f-4e09-8c3f-113f47597eb3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61522025-01-17T08:35:48.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = dc77d346-a87f-4e09-8c3f-113f47597eb3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61532025-01-17T08:35:49.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0752d19b-0b00-4589-b8b0-1d9f334d0d9e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61542025-01-17T08:35:49.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0752d19b-0b00-4589-b8b0-1d9f334d0d9e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61552025-01-17T08:35:49.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0752d19b-0b00-4589-b8b0-1d9f334d0d9e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61562025-01-17T08:35:50.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45329440-1032-4396-bf1f-b425656a144c roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61572025-01-17T08:35:50.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45329440-1032-4396-bf1f-b425656a144c resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61582025-01-17T08:35:50.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 45329440-1032-4396-bf1f-b425656a144c response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61592025-01-17T08:35:51.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9001a2a4-b688-4944-876c-cb911ccc1f53 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61602025-01-17T08:35:51.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9001a2a4-b688-4944-876c-cb911ccc1f53 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61612025-01-17T08:35:51.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9001a2a4-b688-4944-876c-cb911ccc1f53 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61622025-01-17T08:35:51.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
61632025-01-17T08:35:51.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61642025-01-17T08:35:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61652025-01-17T08:35:51.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61662025-01-17T08:35:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61672025-01-17T08:35:51.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61682025-01-17T08:35:51.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61692025-01-17T08:35:51.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
61702025-01-17T08:35:51.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61712025-01-17T08:35:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61722025-01-17T08:35:51.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61732025-01-17T08:35:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61742025-01-17T08:35:51.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61752025-01-17T08:35:51.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61762025-01-17T08:35:51.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61772025-01-17T08:35:51.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.372813ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61782025-01-17T08:35:51.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
61792025-01-17T08:35:51.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61802025-01-17T08:35:51.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61812025-01-17T08:35:51.933ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
61822025-01-17T08:35:51.933ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.203141ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
61832025-01-17T08:35:52.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 03390fe7-f53b-4811-b56d-0167e52c9f50 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61842025-01-17T08:35:52.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 03390fe7-f53b-4811-b56d-0167e52c9f50 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61852025-01-17T08:35:52.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 03390fe7-f53b-4811-b56d-0167e52c9f50 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61862025-01-17T08:35:53.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f5d07d6-82e0-4b68-ac2e-14973d2e09f0 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61872025-01-17T08:35:53.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f5d07d6-82e0-4b68-ac2e-14973d2e09f0 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61882025-01-17T08:35:53.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7f5d07d6-82e0-4b68-ac2e-14973d2e09f0 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61892025-01-17T08:35:53.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 591 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 08987aaf-13c2-4647-9213-0d5ced8d3457 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
61902025-01-17T08:35:54.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05051163-20d2-45bf-82f6-55eae4c7c196 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61912025-01-17T08:35:54.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05051163-20d2-45bf-82f6-55eae4c7c196 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61922025-01-17T08:35:54.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 05051163-20d2-45bf-82f6-55eae4c7c196 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61932025-01-17T08:35:55.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5d0b3d9-0920-4526-9ef7-e17b02ad150e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61942025-01-17T08:35:55.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5d0b3d9-0920-4526-9ef7-e17b02ad150e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61952025-01-17T08:35:55.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c5d0b3d9-0920-4526-9ef7-e17b02ad150e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61962025-01-17T08:35:56.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9583108d-974d-45ab-b06f-eb2ed476993b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61972025-01-17T08:35:56.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9583108d-974d-45ab-b06f-eb2ed476993b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61982025-01-17T08:35:56.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9583108d-974d-45ab-b06f-eb2ed476993b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
61992025-01-17T08:35:57.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2ca11a-7df5-4eeb-96e0-4fcf404b90a9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62002025-01-17T08:35:57.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2ca11a-7df5-4eeb-96e0-4fcf404b90a9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62012025-01-17T08:35:57.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4e2ca11a-7df5-4eeb-96e0-4fcf404b90a9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62022025-01-17T08:35:58.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 89ca71c4-61ba-4444-9732-900c9c22393b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62032025-01-17T08:35:58.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 89ca71c4-61ba-4444-9732-900c9c22393b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62042025-01-17T08:35:58.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1850 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 89ca71c4-61ba-4444-9732-900c9c22393b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62052025-01-17T08:35:59.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e06e4d19-cbde-475f-8b56-4de3bca7e189 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62062025-01-17T08:35:59.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e06e4d19-cbde-475f-8b56-4de3bca7e189 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62072025-01-17T08:35:59.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1936 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e06e4d19-cbde-475f-8b56-4de3bca7e189 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62082025-01-17T08:36:00.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 67a59e24-8b64-4e1d-a6ab-6125714c709d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62092025-01-17T08:36:00.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 67a59e24-8b64-4e1d-a6ab-6125714c709d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62102025-01-17T08:36:00.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 67a59e24-8b64-4e1d-a6ab-6125714c709d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62112025-01-17T08:36:01.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 708108f8-d268-408f-b9f5-86852cd94ba3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62122025-01-17T08:36:01.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 708108f8-d268-408f-b9f5-86852cd94ba3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62132025-01-17T08:36:01.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 708108f8-d268-408f-b9f5-86852cd94ba3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62142025-01-17T08:36:01.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
62152025-01-17T08:36:01.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62162025-01-17T08:36:01.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62172025-01-17T08:36:01.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62182025-01-17T08:36:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62192025-01-17T08:36:01.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62202025-01-17T08:36:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62212025-01-17T08:36:01.891ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
62222025-01-17T08:36:01.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62232025-01-17T08:36:01.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62242025-01-17T08:36:01.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62252025-01-17T08:36:01.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62262025-01-17T08:36:01.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62272025-01-17T08:36:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
62282025-01-17T08:36:01.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62292025-01-17T08:36:01.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62302025-01-17T08:36:01.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
62312025-01-17T08:36:01.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.605995ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
62322025-01-17T08:36:01.918ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62332025-01-17T08:36:01.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62342025-01-17T08:36:01.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.814098ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62352025-01-17T08:36:02.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20c5ec72-798e-4a08-a05d-a66696e668f3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62362025-01-17T08:36:02.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20c5ec72-798e-4a08-a05d-a66696e668f3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62372025-01-17T08:36:02.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 20c5ec72-798e-4a08-a05d-a66696e668f3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62382025-01-17T08:36:03.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4c63e92e-6b3b-47c3-bea8-5d10c5e659b3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62392025-01-17T08:36:03.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4c63e92e-6b3b-47c3-bea8-5d10c5e659b3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62402025-01-17T08:36:03.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4c63e92e-6b3b-47c3-bea8-5d10c5e659b3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62412025-01-17T08:36:03.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 96a1c6f6-3410-4998-afbc-a44748237800 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
62422025-01-17T08:36:04.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1eb25a16-c215-451c-aecc-e2ab702c02bd roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62432025-01-17T08:36:04.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1eb25a16-c215-451c-aecc-e2ab702c02bd resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62442025-01-17T08:36:04.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 1eb25a16-c215-451c-aecc-e2ab702c02bd response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62452025-01-17T08:36:05.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0233020-108b-4d7e-80aa-fb1912cf893f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62462025-01-17T08:36:05.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0233020-108b-4d7e-80aa-fb1912cf893f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62472025-01-17T08:36:05.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f0233020-108b-4d7e-80aa-fb1912cf893f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62482025-01-17T08:36:06.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 623a345f-cfe0-4909-bffc-092012e77db7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62492025-01-17T08:36:06.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 623a345f-cfe0-4909-bffc-092012e77db7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62502025-01-17T08:36:06.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 623a345f-cfe0-4909-bffc-092012e77db7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62512025-01-17T08:36:07.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42f25ab-10ae-4d48-9781-b444758a2f41 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62522025-01-17T08:36:07.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42f25ab-10ae-4d48-9781-b444758a2f41 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62532025-01-17T08:36:07.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e42f25ab-10ae-4d48-9781-b444758a2f41 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62542025-01-17T08:36:08.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59c3de81-e73d-4a86-bd24-d503f71ac14f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62552025-01-17T08:36:08.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59c3de81-e73d-4a86-bd24-d503f71ac14f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62562025-01-17T08:36:08.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 59c3de81-e73d-4a86-bd24-d503f71ac14f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62572025-01-17T08:36:09.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5882251e-713f-4767-99b1-45c8039d0126 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62582025-01-17T08:36:09.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5882251e-713f-4767-99b1-45c8039d0126 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62592025-01-17T08:36:09.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5882251e-713f-4767-99b1-45c8039d0126 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62602025-01-17T08:36:10.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 75a2c1ad-1597-4025-b1b0-6d1d455fa3e3 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62612025-01-17T08:36:10.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 75a2c1ad-1597-4025-b1b0-6d1d455fa3e3 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62622025-01-17T08:36:10.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2809 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 75a2c1ad-1597-4025-b1b0-6d1d455fa3e3 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62632025-01-17T08:36:11.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0fca4f03-ea84-40de-b0ff-9ef91e49679d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62642025-01-17T08:36:11.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0fca4f03-ea84-40de-b0ff-9ef91e49679d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62652025-01-17T08:36:11.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 0fca4f03-ea84-40de-b0ff-9ef91e49679d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
62662025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
62672025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
62682025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62692025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
62702025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62712025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62722025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
62732025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62742025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
62752025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
62762025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62772025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62782025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
62792025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62802025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
62812025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
62822025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
62832025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62842025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62852025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62862025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62872025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62882025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62892025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62902025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62912025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62922025-01-17T08:36:11.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62932025-01-17T08:36:11.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62942025-01-17T08:36:11.887ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
62952025-01-17T08:36:11.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62962025-01-17T08:36:11.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62972025-01-17T08:36:11.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62982025-01-17T08:36:11.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992025-01-17T08:36:11.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63002025-01-17T08:36:11.890ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.451655ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63012025-01-17T08:36:11.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63022025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
63032025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63042025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63052025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
63062025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63072025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
63082025-01-17T08:36:11.892ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63092025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63102025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63112025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63122025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63132025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63142025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63152025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63162025-01-17T08:36:11.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63172025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63182025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63192025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63202025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63212025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63222025-01-17T08:36:11.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63232025-01-17T08:36:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63242025-01-17T08:36:11.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63252025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
63262025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
63272025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
63282025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63292025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63302025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63312025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
63322025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63332025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63342025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63352025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
63362025-01-17T08:36:11.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63372025-01-17T08:36:11.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 68380589 } })
63382025-01-17T08:36:11.896ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
63392025-01-17T08:36:11.896ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 69339136 } })
63402025-01-17T08:36:11.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
63412025-01-17T08:36:11.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422025-01-17T08:36:11.900ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63432025-01-17T08:36:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63442025-01-17T08:36:11.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63452025-01-17T08:36:11.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63462025-01-17T08:36:11.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63472025-01-17T08:36:11.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63482025-01-17T08:36:11.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63492025-01-17T08:36:11.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63502025-01-17T08:36:11.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2081, tv_nsec: 77318889 } })
63512025-01-17T08:36:11.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63522025-01-17T08:36:11.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
63532025-01-17T08:36:11.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63542025-01-17T08:36:11.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552025-01-17T08:36:11.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63562025-01-17T08:36:11.907ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63572025-01-17T08:36:11.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63582025-01-17T08:36:11.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
63592025-01-17T08:36:11.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63602025-01-17T08:36:11.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63612025-01-17T08:36:11.926ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
63622025-01-17T08:36:11.926ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.376989ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
63632025-01-17T08:36:11.937ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63642025-01-17T08:36:11.937ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63652025-01-17T08:36:11.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63662025-01-17T08:36:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63672025-01-17T08:36:11.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63682025-01-17T08:36:11.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63692025-01-17T08:36:11.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63702025-01-17T08:36:11.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712025-01-17T08:36:11.940ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63722025-01-17T08:36:11.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63732025-01-17T08:36:11.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63742025-01-17T08:36:11.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63752025-01-17T08:36:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63762025-01-17T08:36:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63772025-01-17T08:36:11.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63782025-01-17T08:36:11.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63792025-01-17T08:36:11.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63802025-01-17T08:36:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63812025-01-17T08:36:11.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63822025-01-17T08:36:11.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.372421ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
63832025-01-17T08:36:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63842025-01-17T08:36:11.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63852025-01-17T08:36:11.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63862025-01-17T08:36:11.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63872025-01-17T08:36:11.950ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63882025-01-17T08:36:11.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63892025-01-17T08:36:11.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63902025-01-17T08:36:11.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.734108ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63912025-01-17T08:36:11.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.612826ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
63922025-01-17T08:36:11.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63932025-01-17T08:36:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63942025-01-17T08:36:11.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63952025-01-17T08:36:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63962025-01-17T08:36:11.960ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
63972025-01-17T08:36:11.960ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 74.148247ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
63982025-01-17T08:36:11.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63992025-01-17T08:36:11.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64002025-01-17T08:36:11.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.258213ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64012025-01-17T08:36:11.975ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64022025-01-17T08:36:11.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64032025-01-17T08:36:11.976ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64042025-01-17T08:36:11.976ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.281726ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64052025-01-17T08:36:11.980ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64062025-01-17T08:36:11.980ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64072025-01-17T08:36:11.980ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64082025-01-17T08:36:11.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64092025-01-17T08:36:11.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
64102025-01-17T08:36:11.982ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64112025-01-17T08:36:11.982ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b348fa00-24a5-422c-9435-dd0983f3daaa", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64122025-01-17T08:36:11.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64132025-01-17T08:36:11.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64142025-01-17T08:36:11.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64152025-01-17T08:36:11.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64162025-01-17T08:36:12.069ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64172025-01-17T08:36:12.069ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64182025-01-17T08:36:12.070ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cbf82bf-69a6-461f-8a6b-2180bc03a08d", "content-length": "372", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64192025-01-17T08:36:12.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64202025-01-17T08:36:12.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64212025-01-17T08:36:12.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
64222025-01-17T08:36:12.073ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64232025-01-17T08:36:12.073ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4daa3b99-90f0-4ad1-8d98-19dc933410d3", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64242025-01-17T08:36:12.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64252025-01-17T08:36:12.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64262025-01-17T08:36:12.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64272025-01-17T08:36:12.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64282025-01-17T08:36:12.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 218.201306ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64292025-01-17T08:36:12.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
64302025-01-17T08:36:12.104ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64312025-01-17T08:36:12.105ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc6260b-ec46-4469-a246-4b2bf64f65f7", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64322025-01-17T08:36:12.105ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64332025-01-17T08:36:12.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
64342025-01-17T08:36:12.108ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 222.055087ms iteration = 29 status = {"physical_disks_added":0}
64352025-01-17T08:36:12.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 215.421375ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64362025-01-17T08:36:12.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372025-01-17T08:36:12.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64382025-01-17T08:36:12.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64392025-01-17T08:36:12.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 219.189695ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64402025-01-17T08:36:12.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
64412025-01-17T08:36:12.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64422025-01-17T08:36:12.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64432025-01-17T08:36:12.116ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 230.278352ms iteration = 26 status = 0
64442025-01-17T08:36:12.119ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64452025-01-17T08:36:12.119ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64462025-01-17T08:36:12.119ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "875b1871-2ed7-4e30-9fa4-e46aac00881b", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64472025-01-17T08:36:12.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64482025-01-17T08:36:12.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64492025-01-17T08:36:12.121ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.358082ms iteration = 26 status = {}
64502025-01-17T08:36:12.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64512025-01-17T08:36:12.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64522025-01-17T08:36:12.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64532025-01-17T08:36:12.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64542025-01-17T08:36:12.128ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64552025-01-17T08:36:12.128ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64562025-01-17T08:36:12.129ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "33871892-af47-4c2c-af68-77eee7b4d121", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64572025-01-17T08:36:12.130ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.241835ms iteration = 27 status = {}
64582025-01-17T08:36:12.165ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64592025-01-17T08:36:12.166ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc8372b-5bb1-44bf-8c9f-d7fa5e83960a", "content-length": "2", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64602025-01-17T08:36:12.168ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64612025-01-17T08:36:12.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64622025-01-17T08:36:12.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64632025-01-17T08:36:12.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64642025-01-17T08:36:12.170ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 283.841206ms iteration = 26 status = null
64652025-01-17T08:36:12.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64662025-01-17T08:36:12.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64672025-01-17T08:36:12.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64682025-01-17T08:36:12.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64692025-01-17T08:36:12.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64702025-01-17T08:36:12.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64712025-01-17T08:36:12.236ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
64722025-01-17T08:36:12.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64732025-01-17T08:36:12.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64742025-01-17T08:36:12.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64752025-01-17T08:36:12.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64762025-01-17T08:36:12.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64772025-01-17T08:36:12.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64782025-01-17T08:36:12.247ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64792025-01-17T08:36:12.247ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c7342d-24d1-4f28-9da9-734b26601f25", "content-length": "134", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64802025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64812025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
64822025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64832025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64842025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64852025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64862025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64872025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64882025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64892025-01-17T08:36:12.247ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64902025-01-17T08:36:12.248ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
64912025-01-17T08:36:12.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64922025-01-17T08:36:12.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64932025-01-17T08:36:12.250ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64942025-01-17T08:36:12.250ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7f5eb05-fbb0-4f80-b3cb-8e5cd63bed35", "content-length": "2", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64952025-01-17T08:36:12.250ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64962025-01-17T08:36:12.250ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb178e8f-5d0f-4aaf-8136-b3b081721578", "content-length": "52", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
64972025-01-17T08:36:12.250ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
64982025-01-17T08:36:12.250ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64992025-01-17T08:36:12.334ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65002025-01-17T08:36:12.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8903a22f-bd22-4589-8d8a-4e4060ac98fa", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
65012025-01-17T08:36:12.339ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
65022025-01-17T08:36:12.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65032025-01-17T08:36:12.339ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e6c488b-237c-490f-a58b-f4804a62e16a", "content-length": "691", "date": "Fri, 17 Jan 2025 08:36:11 GMT"} })
65042025-01-17T08:36:12.339ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65052025-01-17T08:36:12.339ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65062025-01-17T08:36:12.339ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65072025-01-17T08:36:12.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "87a03d23-d5a0-4dee-8d12-2dc1e6c4d827", "content-length": "682", "date": "Fri, 17 Jan 2025 08:36:12 GMT"} })
65082025-01-17T08:36:12.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65092025-01-17T08:36:12.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65102025-01-17T08:36:12.340ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.371685ms iteration = 27 status = {}
65112025-01-17T08:36:12.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65122025-01-17T08:36:12.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65132025-01-17T08:36:12.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65142025-01-17T08:36:12.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65152025-01-17T08:36:12.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65162025-01-17T08:36:12.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65172025-01-17T08:36:12.357ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 471.541001ms iteration = 26 status = {}
65182025-01-17T08:36:12.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1fd1b07-dfe6-4ad7-a2dd-a02357698991 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65192025-01-17T08:36:12.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1fd1b07-dfe6-4ad7-a2dd-a02357698991 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65202025-01-17T08:36:12.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = e1fd1b07-dfe6-4ad7-a2dd-a02357698991 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65212025-01-17T08:36:13.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 0d7fb8e7-d67c-49fd-83b8-bea7e9f6497d response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
65222025-01-17T08:36:13.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b99c0a21-ee7c-43d3-a6ce-b4b77b7593d7 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65232025-01-17T08:36:13.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b99c0a21-ee7c-43d3-a6ce-b4b77b7593d7 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65242025-01-17T08:36:13.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b99c0a21-ee7c-43d3-a6ce-b4b77b7593d7 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65252025-01-17T08:36:14.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c73e0937-6839-4744-93f6-d61c12e3fada roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65262025-01-17T08:36:14.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c73e0937-6839-4744-93f6-d61c12e3fada resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65272025-01-17T08:36:14.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c73e0937-6839-4744-93f6-d61c12e3fada response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65282025-01-17T08:36:14.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f38a8-6a06-4ba7-9882-2a9c33e5ee47 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
65292025-01-17T08:36:14.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f38a8-6a06-4ba7-9882-2a9c33e5ee47 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
65302025-01-17T08:36:14.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 073f38a8-6a06-4ba7-9882-2a9c33e5ee47 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
65312025-01-17T08:36:15.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b82da907-8c0c-4b41-a0ac-61146f5dec82 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65322025-01-17T08:36:15.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b82da907-8c0c-4b41-a0ac-61146f5dec82 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65332025-01-17T08:36:15.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3078 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b82da907-8c0c-4b41-a0ac-61146f5dec82 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65342025-01-17T08:36:16.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 335d83a9-bbc0-473c-9d6a-43fddced39fc roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65352025-01-17T08:36:16.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 335d83a9-bbc0-473c-9d6a-43fddced39fc resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65362025-01-17T08:36:16.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 335d83a9-bbc0-473c-9d6a-43fddced39fc response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65372025-01-17T08:36:17.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 00b0883c-c233-4603-a995-1cec949f2903 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65382025-01-17T08:36:17.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 00b0883c-c233-4603-a995-1cec949f2903 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65392025-01-17T08:36:17.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 00b0883c-c233-4603-a995-1cec949f2903 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65402025-01-17T08:36:18.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9df0b79b-a162-4ff8-924c-d245966b3024 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65412025-01-17T08:36:18.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9df0b79b-a162-4ff8-924c-d245966b3024 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65422025-01-17T08:36:18.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 9df0b79b-a162-4ff8-924c-d245966b3024 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65432025-01-17T08:36:19.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f189b8f4-b47e-4053-9119-93e547b0724e roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65442025-01-17T08:36:19.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f189b8f4-b47e-4053-9119-93e547b0724e resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65452025-01-17T08:36:19.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3004 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f189b8f4-b47e-4053-9119-93e547b0724e response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65462025-01-17T08:36:20.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d89b717-db34-49a2-8b40-2e8d769ca28f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65472025-01-17T08:36:20.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d89b717-db34-49a2-8b40-2e8d769ca28f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65482025-01-17T08:36:20.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d89b717-db34-49a2-8b40-2e8d769ca28f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65492025-01-17T08:36:21.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e5db330-26cc-4d43-98bf-a4a217f0bc2b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65502025-01-17T08:36:21.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e5db330-26cc-4d43-98bf-a4a217f0bc2b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65512025-01-17T08:36:21.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 5e5db330-26cc-4d43-98bf-a4a217f0bc2b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65522025-01-17T08:36:21.886ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
65532025-01-17T08:36:21.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65542025-01-17T08:36:21.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65552025-01-17T08:36:21.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65562025-01-17T08:36:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65572025-01-17T08:36:21.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65582025-01-17T08:36:21.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65592025-01-17T08:36:21.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
65602025-01-17T08:36:21.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65612025-01-17T08:36:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65622025-01-17T08:36:21.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65632025-01-17T08:36:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65642025-01-17T08:36:21.921ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65652025-01-17T08:36:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65662025-01-17T08:36:21.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672025-01-17T08:36:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.006435ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65682025-01-17T08:36:21.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
65692025-01-17T08:36:21.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65702025-01-17T08:36:21.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65712025-01-17T08:36:21.941ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
65722025-01-17T08:36:21.941ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.421478ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
65732025-01-17T08:36:22.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3372e8cb-9d1f-4ae6-baff-7862fbd5dc2b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65742025-01-17T08:36:22.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3372e8cb-9d1f-4ae6-baff-7862fbd5dc2b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65752025-01-17T08:36:22.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3372e8cb-9d1f-4ae6-baff-7862fbd5dc2b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65762025-01-17T08:36:23.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 613 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 28f2c134-bf8e-4cb9-8031-8950b43fa852 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
65772025-01-17T08:36:23.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bef5d565-c54d-423e-95c7-3ebfe3ad02d9 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65782025-01-17T08:36:23.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bef5d565-c54d-423e-95c7-3ebfe3ad02d9 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65792025-01-17T08:36:23.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = bef5d565-c54d-423e-95c7-3ebfe3ad02d9 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65802025-01-17T08:36:24.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49fa6aaa-cf6e-42a7-abe3-79c629497d53 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65812025-01-17T08:36:24.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49fa6aaa-cf6e-42a7-abe3-79c629497d53 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65822025-01-17T08:36:24.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 49fa6aaa-cf6e-42a7-abe3-79c629497d53 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65832025-01-17T08:36:25.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99f90a45-f101-49c4-a7a6-6da82cb9e543 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65842025-01-17T08:36:25.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99f90a45-f101-49c4-a7a6-6da82cb9e543 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65852025-01-17T08:36:25.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 99f90a45-f101-49c4-a7a6-6da82cb9e543 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65862025-01-17T08:36:26.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 369a39c3-e54d-49d1-94d1-b1ca6d6853d2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65872025-01-17T08:36:26.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 369a39c3-e54d-49d1-94d1-b1ca6d6853d2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65882025-01-17T08:36:26.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 369a39c3-e54d-49d1-94d1-b1ca6d6853d2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65892025-01-17T08:36:27.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d82c0e3-8b62-4e5f-98c8-7d8a39572d84 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65902025-01-17T08:36:27.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d82c0e3-8b62-4e5f-98c8-7d8a39572d84 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65912025-01-17T08:36:27.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 8d82c0e3-8b62-4e5f-98c8-7d8a39572d84 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65922025-01-17T08:36:28.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d891587d-383e-4b2d-85fb-2de575ab3bcb roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65932025-01-17T08:36:28.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d891587d-383e-4b2d-85fb-2de575ab3bcb resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65942025-01-17T08:36:28.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d891587d-383e-4b2d-85fb-2de575ab3bcb response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65952025-01-17T08:36:29.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2f5ffe71-85bd-4faa-9465-977d2df72025 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65962025-01-17T08:36:29.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2f5ffe71-85bd-4faa-9465-977d2df72025 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65972025-01-17T08:36:29.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 2f5ffe71-85bd-4faa-9465-977d2df72025 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65982025-01-17T08:36:30.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3cf8eddc-e3b9-4be1-8a8e-c0465bb295d1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
65992025-01-17T08:36:30.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3cf8eddc-e3b9-4be1-8a8e-c0465bb295d1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66002025-01-17T08:36:30.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2977 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 3cf8eddc-e3b9-4be1-8a8e-c0465bb295d1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66012025-01-17T08:36:31.886ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
66022025-01-17T08:36:31.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66032025-01-17T08:36:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66042025-01-17T08:36:31.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66052025-01-17T08:36:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66062025-01-17T08:36:31.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66072025-01-17T08:36:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66082025-01-17T08:36:31.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
66092025-01-17T08:36:31.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66102025-01-17T08:36:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66112025-01-17T08:36:31.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66122025-01-17T08:36:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66132025-01-17T08:36:31.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66142025-01-17T08:36:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66152025-01-17T08:36:31.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66162025-01-17T08:36:31.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.623169ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66172025-01-17T08:36:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
66182025-01-17T08:36:31.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66192025-01-17T08:36:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66202025-01-17T08:36:31.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
66212025-01-17T08:36:31.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.311771ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
66222025-01-17T08:36:32.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f614fdd1-86d4-45df-9bfa-50d1fa57a7c2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66232025-01-17T08:36:32.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f614fdd1-86d4-45df-9bfa-50d1fa57a7c2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66242025-01-17T08:36:32.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = f614fdd1-86d4-45df-9bfa-50d1fa57a7c2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66252025-01-17T08:36:33.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 08bc88b3-2c6b-445a-a16f-1907e468620f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66262025-01-17T08:36:33.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 08bc88b3-2c6b-445a-a16f-1907e468620f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66272025-01-17T08:36:33.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2760 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 08bc88b3-2c6b-445a-a16f-1907e468620f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66282025-01-17T08:36:33.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 91901baf-3bf3-4228-bdde-b0cfd6bbe712 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
66292025-01-17T08:36:34.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 962acedb-02cf-4680-af30-5ec4aeb9d338 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66302025-01-17T08:36:34.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 962acedb-02cf-4680-af30-5ec4aeb9d338 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66312025-01-17T08:36:34.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1974 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 962acedb-02cf-4680-af30-5ec4aeb9d338 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66322025-01-17T08:36:35.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a852c636-a70b-4e33-aa08-29853ebbed1f roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66332025-01-17T08:36:35.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a852c636-a70b-4e33-aa08-29853ebbed1f resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66342025-01-17T08:36:35.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a852c636-a70b-4e33-aa08-29853ebbed1f response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66352025-01-17T08:36:36.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 619afaf9-68f0-44fa-a005-06ebc8200648 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66362025-01-17T08:36:36.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 619afaf9-68f0-44fa-a005-06ebc8200648 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66372025-01-17T08:36:36.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 619afaf9-68f0-44fa-a005-06ebc8200648 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66382025-01-17T08:36:37.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a93a71ba-b20d-4110-aae6-04b8a0ccdd49 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66392025-01-17T08:36:37.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a93a71ba-b20d-4110-aae6-04b8a0ccdd49 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66402025-01-17T08:36:37.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = a93a71ba-b20d-4110-aae6-04b8a0ccdd49 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66412025-01-17T08:36:38.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 44cd3b27-8a92-4be3-935a-7918668f558b roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66422025-01-17T08:36:38.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 44cd3b27-8a92-4be3-935a-7918668f558b resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66432025-01-17T08:36:38.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 44cd3b27-8a92-4be3-935a-7918668f558b response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66442025-01-17T08:36:39.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc536758-493a-46ea-a19b-41af08c97311 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66452025-01-17T08:36:39.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc536758-493a-46ea-a19b-41af08c97311 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66462025-01-17T08:36:39.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = cc536758-493a-46ea-a19b-41af08c97311 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66472025-01-17T08:36:40.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a960915-9fd1-4cd8-a206-aae9a67fc92d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66482025-01-17T08:36:40.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a960915-9fd1-4cd8-a206-aae9a67fc92d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66492025-01-17T08:36:40.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7a960915-9fd1-4cd8-a206-aae9a67fc92d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66502025-01-17T08:36:41.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dcb5afb-dcd2-4e9c-b08b-8a9cbb7058f2 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66512025-01-17T08:36:41.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dcb5afb-dcd2-4e9c-b08b-8a9cbb7058f2 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66522025-01-17T08:36:41.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7dcb5afb-dcd2-4e9c-b08b-8a9cbb7058f2 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
66532025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
66542025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66552025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
66562025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66572025-01-17T08:36:41.885ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-17 08:26:41.885375059 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66582025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
66592025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66602025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
66612025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
66622025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
66632025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66642025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66652025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
66662025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66672025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66682025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66692025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
66702025-01-17T08:36:41.885ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
66712025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66722025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
66732025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66742025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66752025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
66762025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
66772025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66782025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66792025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
66802025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
66812025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66822025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66832025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
66842025-01-17T08:36:41.886ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 0d84e4a5-4993-4254-8557-154c115d4835
66852025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.49\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"0d84e4a5-4993-4254-8557-154c115d4835"}
66862025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
66872025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
66882025-01-17T08:36:41.886ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66892025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
66902025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66912025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66922025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
66932025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66942025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
66952025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66962025-01-17T08:36:41.886ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("18904103-4d17-4503-9e6b-f36462ac2ff6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ab585232-40d2-4a9e-a5a8-6d9e5f36808d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 58537431 } })
66972025-01-17T08:36:41.886ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("031d4967-d152-46af-88a4-eb487b5c2f7a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("25507f08-a286-439f-b2a0-e23f9b5d951a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c6ef6b3a-8349-47f8-94bf-cee694328219.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 58581581 } })
66982025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66992025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67002025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67012025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67022025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67032025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67042025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67052025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67062025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67072025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67082025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67092025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
67102025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.30351ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
67112025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
67122025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.367161ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
67132025-01-17T08:36:41.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67142025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67152025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67162025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
67172025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67182025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67192025-01-17T08:36:41.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67202025-01-17T08:36:41.888ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-17 08:26:41.885375059 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67212025-01-17T08:36:41.888ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.848103ms iteration = 14 status = {"expiration":"2025-01-17T08:26:41.885375059Z","pruned":[]}
67222025-01-17T08:36:41.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67242025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67252025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67262025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67272025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67282025-01-17T08:36:41.891ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.430523ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67292025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
67302025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
67312025-01-17T08:36:41.892ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67322025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67332025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67342025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67352025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
67362025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67372025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
67382025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67392025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67402025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67412025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67422025-01-17T08:36:41.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67432025-01-17T08:36:41.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67442025-01-17T08:36:41.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67452025-01-17T08:36:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67462025-01-17T08:36:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
67472025-01-17T08:36:41.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67482025-01-17T08:36:41.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67492025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
67502025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67512025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
67522025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67532025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
67542025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67552025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
67562025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67572025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
67582025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67592025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
67602025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67612025-01-17T08:36:41.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 67610152 } })
67622025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67632025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67642025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67652025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67662025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67672025-01-17T08:36:41.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67682025-01-17T08:36:41.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
67692025-01-17T08:36:41.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67702025-01-17T08:36:41.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67712025-01-17T08:36:41.897ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 69551478 } })
67722025-01-17T08:36:41.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67732025-01-17T08:36:41.897ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
67742025-01-17T08:36:41.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67752025-01-17T08:36:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67762025-01-17T08:36:41.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67772025-01-17T08:36:41.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67782025-01-17T08:36:41.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67792025-01-17T08:36:41.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67802025-01-17T08:36:41.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67812025-01-17T08:36:41.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67822025-01-17T08:36:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67832025-01-17T08:36:41.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67842025-01-17T08:36:41.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67852025-01-17T08:36:41.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67862025-01-17T08:36:41.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67872025-01-17T08:36:41.905ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.798286ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
67882025-01-17T08:36:41.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fbac3378-7daf-4aef-b0f5-d2cd5264f30e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2111, tv_nsec: 85855417 } })
67892025-01-17T08:36:41.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67902025-01-17T08:36:41.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
67912025-01-17T08:36:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67922025-01-17T08:36:41.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67932025-01-17T08:36:41.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67942025-01-17T08:36:41.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952025-01-17T08:36:41.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67962025-01-17T08:36:41.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67972025-01-17T08:36:41.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67982025-01-17T08:36:41.943ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67992025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68002025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68012025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68022025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68032025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68042025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052025-01-17T08:36:41.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68062025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68072025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68082025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68092025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68102025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68112025-01-17T08:36:41.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68122025-01-17T08:36:41.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132025-01-17T08:36:41.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68142025-01-17T08:36:41.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68152025-01-17T08:36:41.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68162025-01-17T08:36:41.955ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68172025-01-17T08:36:41.955ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68182025-01-17T08:36:41.955ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68192025-01-17T08:36:41.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68202025-01-17T08:36:41.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68212025-01-17T08:36:41.956ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68222025-01-17T08:36:41.956ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68232025-01-17T08:36:41.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68242025-01-17T08:36:41.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68252025-01-17T08:36:41.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68262025-01-17T08:36:41.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68272025-01-17T08:36:41.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68282025-01-17T08:36:41.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68292025-01-17T08:36:41.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68302025-01-17T08:36:41.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312025-01-17T08:36:41.960ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68322025-01-17T08:36:41.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68332025-01-17T08:36:41.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68342025-01-17T08:36:41.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68352025-01-17T08:36:41.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68362025-01-17T08:36:41.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68372025-01-17T08:36:41.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68382025-01-17T08:36:41.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68392025-01-17T08:36:41.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68402025-01-17T08:36:41.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68412025-01-17T08:36:41.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.233615ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
68422025-01-17T08:36:41.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68432025-01-17T08:36:41.966ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.771849ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68442025-01-17T08:36:41.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68452025-01-17T08:36:41.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68462025-01-17T08:36:41.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68472025-01-17T08:36:41.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.44244ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
68482025-01-17T08:36:41.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68492025-01-17T08:36:41.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68502025-01-17T08:36:41.974ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68512025-01-17T08:36:41.975ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68522025-01-17T08:36:41.975ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.693393ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68532025-01-17T08:36:41.975ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68542025-01-17T08:36:41.975ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68552025-01-17T08:36:41.975ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.685519ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68562025-01-17T08:36:41.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68572025-01-17T08:36:41.976ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68582025-01-17T08:36:41.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68592025-01-17T08:36:41.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.019606ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68602025-01-17T08:36:41.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68612025-01-17T08:36:41.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68622025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68632025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68642025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68652025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68662025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68672025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68682025-01-17T08:36:41.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68692025-01-17T08:36:41.993ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68702025-01-17T08:36:41.993ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68712025-01-17T08:36:41.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68722025-01-17T08:36:41.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68732025-01-17T08:36:41.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68742025-01-17T08:36:41.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68752025-01-17T08:36:42.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68762025-01-17T08:36:42.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68772025-01-17T08:36:42.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.00009ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68782025-01-17T08:36:42.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68792025-01-17T08:36:42.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68802025-01-17T08:36:42.003ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68812025-01-17T08:36:42.003ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68822025-01-17T08:36:42.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68832025-01-17T08:36:42.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68842025-01-17T08:36:42.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68852025-01-17T08:36:42.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.798147ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68862025-01-17T08:36:42.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68872025-01-17T08:36:42.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68882025-01-17T08:36:42.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
68892025-01-17T08:36:42.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68902025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68912025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68922025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68932025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68942025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68952025-01-17T08:36:42.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68962025-01-17T08:36:42.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68972025-01-17T08:36:42.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1f3808ff-5ca9-43fe-ad90-068e6f16a9c9 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
68982025-01-17T08:36:42.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68992025-01-17T08:36:42.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-17 08:23:52.728259 UTC dns_group = internal generation = 1
69002025-01-17T08:36:42.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 127.64113ms iteration = 14 status = {"generation":1}
69012025-01-17T08:36:42.016ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
69022025-01-17T08:36:42.016ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.881355ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
69032025-01-17T08:36:42.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69042025-01-17T08:36:42.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69052025-01-17T08:36:42.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69062025-01-17T08:36:42.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69072025-01-17T08:36:42.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69082025-01-17T08:36:42.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69092025-01-17T08:36:42.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69102025-01-17T08:36:42.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fbac3378-7daf-4aef-b0f5-d2cd5264f30e, lookup_type: ById(fbac3378-7daf-4aef-b0f5-d2cd5264f30e) } result = Ok(())
69112025-01-17T08:36:42.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69122025-01-17T08:36:42.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69132025-01-17T08:36:42.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.986074ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69142025-01-17T08:36:42.029ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69152025-01-17T08:36:42.029ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 0 version = 2
69162025-01-17T08:36:42.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69172025-01-17T08:36:42.029ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.115013ms iteration = 27 status = 0
69182025-01-17T08:36:42.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69192025-01-17T08:36:42.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
69202025-01-17T08:36:42.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 149.249161ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
69212025-01-17T08:36:42.037ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69222025-01-17T08:36:42.037ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69232025-01-17T08:36:42.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.783003ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69242025-01-17T08:36:42.052ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
69252025-01-17T08:36:42.052ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69262025-01-17T08:36:42.053ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "55854685-aa29-4967-8c68-1709472e9ed1", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} })
69272025-01-17T08:36:42.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69282025-01-17T08:36:42.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69292025-01-17T08:36:42.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69302025-01-17T08:36:42.061ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.459588ms iteration = 30 status = {"physical_disks_added":0}
69312025-01-17T08:36:42.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69322025-01-17T08:36:42.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69332025-01-17T08:36:42.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69342025-01-17T08:36:42.064ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2bd0e4f8-5c4a-4872-b1d2-e6802a15e657 dns_zone_name = oxide.test found_so_far = 1 version = 2
69352025-01-17T08:36:42.064ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69362025-01-17T08:36:42.064ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-17 08:23:54.065939 UTC dns_group = external generation = 2
69372025-01-17T08:36:42.064ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.928796ms iteration = 14 status = {"generation":2}
69382025-01-17T08:36:42.072ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-17T08:23:38.369103Z, time_modified: 2025-01-17T08:23:38.369103Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, db_silo: Silo { identity: SiloIdentity { id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-17T08:23:53.963723Z, time_modified: 2025-01-17T08:23:53.963723Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418" }] }) }
69392025-01-17T08:36:42.072ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.401505ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]}},"default_endpoint":{"silo_id":"603edd29-2275-4ced-9f13-a1ccdff45ca3","tls_certs":["9c531e267b786ad6b1a1efa831d54c250d9dafe9058be0be00dd6ac804edf418"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69402025-01-17T08:36:42.101ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69412025-01-17T08:36:42.101ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.418607ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69422025-01-17T08:36:42.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69432025-01-17T08:36:42.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69442025-01-17T08:36:42.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69452025-01-17T08:36:42.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69462025-01-17T08:36:42.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69472025-01-17T08:36:42.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69482025-01-17T08:36:42.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69492025-01-17T08:36:42.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69502025-01-17T08:36:42.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69512025-01-17T08:36:42.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69522025-01-17T08:36:42.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
69532025-01-17T08:36:42.185ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69542025-01-17T08:36:42.185ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "369e6c66-cf59-44ed-a025-24b09dc00611", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} })
69552025-01-17T08:36:42.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69562025-01-17T08:36:42.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69572025-01-17T08:36:42.189ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69582025-01-17T08:36:42.194ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f zone_address = fd00:1122:3344:101::2
69592025-01-17T08:36:42.194ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69602025-01-17T08:36:42.194ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf29f05-63d5-415e-a091-96fe66051829", "content-length": "26", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} })
69612025-01-17T08:36:42.194ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69622025-01-17T08:36:42.196ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
69632025-01-17T08:36:42.214ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69642025-01-17T08:36:42.227ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69652025-01-17T08:36:42.227ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69662025-01-17T08:36:42.228ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "669f067c-eb0b-4f98-a1e6-c565181e135e", "content-length": "372", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
69672025-01-17T08:36:42.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69682025-01-17T08:36:42.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69692025-01-17T08:36:42.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 809c7942-b5ff-4d6c-89ed-ca82877262db roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
69702025-01-17T08:36:42.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 809c7942-b5ff-4d6c-89ed-ca82877262db resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
69712025-01-17T08:36:42.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 809c7942-b5ff-4d6c-89ed-ca82877262db response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
69722025-01-17T08:36:42.240ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69732025-01-17T08:36:42.240ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f068f40-7e14-4c8b-99a4-19c790c8e7a3", "content-length": "2", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
69742025-01-17T08:36:42.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69752025-01-17T08:36:42.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69762025-01-17T08:36:42.243ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.855211ms iteration = 27 status = null
69772025-01-17T08:36:42.270ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69782025-01-17T08:36:42.270ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69792025-01-17T08:36:42.270ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0b7b3ae9-4ed7-47db-93cb-6f59c02d6fa2", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
69802025-01-17T08:36:42.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69812025-01-17T08:36:42.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69822025-01-17T08:36:42.382ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69832025-01-17T08:36:42.382ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "11d3b301-010e-4ba9-b39e-0809421a94fa", "content-length": "691", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
69842025-01-17T08:36:42.382ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
69852025-01-17T08:36:42.382ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
69862025-01-17T08:36:42.382ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
69872025-01-17T08:36:42.383ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 498.025211ms iteration = 28 status = {}
69882025-01-17T08:36:42.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69892025-01-17T08:36:42.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69902025-01-17T08:36:42.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69912025-01-17T08:36:42.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69922025-01-17T08:36:42.390ZINFOnexus (BackgroundTasks): VPC route manager sled fbac3378-7daf-4aef-b0f5-d2cd5264f30e push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69932025-01-17T08:36:42.390ZDEBGnexus (BackgroundTasks): client request SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69942025-01-17T08:36:42.390ZDEBGnexus (BackgroundTasks): client response SledAgent = fbac3378-7daf-4aef-b0f5-d2cd5264f30e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d3858c7-6d32-4b31-9627-9118d926070d", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
69952025-01-17T08:36:42.392ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 500.296109ms iteration = 28 status = {}
69962025-01-17T08:36:42.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69972025-01-17T08:36:42.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0863d00f-d377-49c4-9b17-cc985eca4e08", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69982025-01-17T08:36:42.562ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
69992025-01-17T08:36:42.563ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
70002025-01-17T08:36:42.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "14ca3a12-2b06-4eee-abe7-f4c854706234", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
70012025-01-17T08:36:42.564ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
70022025-01-17T08:36:42.564ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 678.865662ms iteration = 27 status = {}
70032025-01-17T08:36:42.566ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
70042025-01-17T08:36:42.566ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 681.363822ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70052025-01-17T08:36:42.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70062025-01-17T08:36:42.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70072025-01-17T08:36:42.576ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 48bc9d12-27a8-4009-9976-0a9e792ae618, rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(204954e0-22f7-4c73-9e2c-04a2816c7227) } rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
70082025-01-17T08:36:42.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70092025-01-17T08:36:42.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70102025-01-17T08:36:42.586ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70112025-01-17T08:36:42.586ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a466ebc-fd57-4b1d-a8c7-040c4d90e8d6", "content-length": "134", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
70122025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70132025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 204954e0-22f7-4c73-9e2c-04a2816c7227
70142025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70152025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70162025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70172025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70182025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70192025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70202025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70212025-01-17T08:36:42.586ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70222025-01-17T08:36:42.587ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f
70232025-01-17T08:36:42.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70242025-01-17T08:36:42.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70252025-01-17T08:36:42.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70262025-01-17T08:36:42.589ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e680470-5087-4881-b278-bff4ce1b0849", "content-length": "2", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
70272025-01-17T08:36:42.589ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70282025-01-17T08:36:42.589ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c7a5c5d-24f6-42ed-ae40-15d31b44d2ae", "content-length": "52", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
70292025-01-17T08:36:42.589ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch_location = Switch0
70302025-01-17T08:36:42.589ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70312025-01-17T08:36:42.597ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70322025-01-17T08:36:42.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d6838992-bb7c-463f-8970-d84c97e2f36b", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70332025-01-17T08:36:42.597ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70342025-01-17T08:36:42.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "86a6a613-3669-4e7f-b1dd-4a03a1f40e87", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70352025-01-17T08:36:42.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70362025-01-17T08:36:42.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "967171c5-6d81-4fd5-aa83-5f85fecb0ccc", "date": "Fri, 17 Jan 2025 08:36:42 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70372025-01-17T08:36:42.601ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70382025-01-17T08:36:42.603ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70392025-01-17T08:36:42.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 718.152082ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70402025-01-17T08:36:42.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ca8c603b-0551-4109-a27a-cf8301d6abb7", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
70412025-01-17T08:36:42.682ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f switch = Switch0
70422025-01-17T08:36:42.682ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70432025-01-17T08:36:42.683ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = d35a4c82-5298-4dae-8513-0a85ba980a8f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e79fd294-eb75-4910-8900-b1e2977f307a", "content-length": "682", "date": "Fri, 17 Jan 2025 08:36:41 GMT"} })
70442025-01-17T08:36:42.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70452025-01-17T08:36:42.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70462025-01-17T08:36:42.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70472025-01-17T08:36:42.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70482025-01-17T08:36:42.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70492025-01-17T08:36:42.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70502025-01-17T08:36:42.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70512025-01-17T08:36:42.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70522025-01-17T08:36:42.698ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 812.75159ms iteration = 27 status = {}
70532025-01-17T08:36:43.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 758091e7-873b-4322-b541-67a531a8c845 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70542025-01-17T08:36:43.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 758091e7-873b-4322-b541-67a531a8c845 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70552025-01-17T08:36:43.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 758091e7-873b-4322-b541-67a531a8c845 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70562025-01-17T08:36:43.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 653 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = b81d44b2-37b9-4653-8668-44c38d47ff49 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
70572025-01-17T08:36:44.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42a60b9-307b-491b-b44c-30aba3752c64 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70582025-01-17T08:36:44.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42a60b9-307b-491b-b44c-30aba3752c64 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70592025-01-17T08:36:44.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c42a60b9-307b-491b-b44c-30aba3752c64 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70602025-01-17T08:36:44.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 6fe6575a-8b65-4b68-ba6f-ebd6844b6f86 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
70612025-01-17T08:36:44.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 6fe6575a-8b65-4b68-ba6f-ebd6844b6f86 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
70622025-01-17T08:36:44.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:56510 req_id = 6fe6575a-8b65-4b68-ba6f-ebd6844b6f86 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
70632025-01-17T08:36:45.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea46a96b-01f8-4de0-b21b-cb07e8cef775 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70642025-01-17T08:36:45.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea46a96b-01f8-4de0-b21b-cb07e8cef775 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70652025-01-17T08:36:45.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ea46a96b-01f8-4de0-b21b-cb07e8cef775 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70662025-01-17T08:36:46.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36ecf55b-b7b3-4046-9c99-b6a8eb04f139 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70672025-01-17T08:36:46.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36ecf55b-b7b3-4046-9c99-b6a8eb04f139 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70682025-01-17T08:36:46.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 36ecf55b-b7b3-4046-9c99-b6a8eb04f139 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70692025-01-17T08:36:47.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d71a286-054c-4def-9585-0f49e1b0d618 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70702025-01-17T08:36:47.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d71a286-054c-4def-9585-0f49e1b0d618 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70712025-01-17T08:36:47.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 4d71a286-054c-4def-9585-0f49e1b0d618 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70722025-01-17T08:36:48.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca578300-1db5-4bab-a7e0-4793ab9ee900 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70732025-01-17T08:36:48.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca578300-1db5-4bab-a7e0-4793ab9ee900 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70742025-01-17T08:36:48.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = ca578300-1db5-4bab-a7e0-4793ab9ee900 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70752025-01-17T08:36:49.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b77b9715-81e5-4a91-bc34-47a73e972851 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70762025-01-17T08:36:49.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b77b9715-81e5-4a91-bc34-47a73e972851 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70772025-01-17T08:36:49.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = b77b9715-81e5-4a91-bc34-47a73e972851 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70782025-01-17T08:36:50.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42432b16-f01b-4439-9eb2-82ebc8c9c42d roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70792025-01-17T08:36:50.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42432b16-f01b-4439-9eb2-82ebc8c9c42d resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70802025-01-17T08:36:50.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 42432b16-f01b-4439-9eb2-82ebc8c9c42d response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70812025-01-17T08:36:51.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b0a4136-c1d3-4545-99a2-cede46100392 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70822025-01-17T08:36:51.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b0a4136-c1d3-4545-99a2-cede46100392 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70832025-01-17T08:36:51.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 7b0a4136-c1d3-4545-99a2-cede46100392 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
70842025-01-17T08:36:51.886ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
70852025-01-17T08:36:51.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70862025-01-17T08:36:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70872025-01-17T08:36:51.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70882025-01-17T08:36:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70892025-01-17T08:36:51.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70902025-01-17T08:36:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70912025-01-17T08:36:51.892ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
70922025-01-17T08:36:51.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70932025-01-17T08:36:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70942025-01-17T08:36:51.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70952025-01-17T08:36:51.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70962025-01-17T08:36:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70972025-01-17T08:36:51.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70982025-01-17T08:36:51.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.423467ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70992025-01-17T08:36:51.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71002025-01-17T08:36:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0d84e4a5-4993-4254-8557-154c115d4835, lookup_type: ById(0d84e4a5-4993-4254-8557-154c115d4835) } result = Ok(())
71012025-01-17T08:36:51.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022025-01-17T08:36:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71032025-01-17T08:36:51.910ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0d84e4a5-4993-4254-8557-154c115d4835 original_time_created = 2025-01-17 08:23:34.728603 UTC target_id = 0d84e4a5-4993-4254-8557-154c115d4835 time_created = 2025-01-17 08:23:34.728603 UTC
71042025-01-17T08:36:51.910ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.492054ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0d84e4a5-4993-4254-8557-154c115d4835","time_created":"2025-01-17T08:23:34.728603Z"}
71052025-01-17T08:36:52.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 057b0c8a-f096-4bfd-8d9c-906d85c03e81 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71062025-01-17T08:36:52.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 057b0c8a-f096-4bfd-8d9c-906d85c03e81 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71072025-01-17T08:36:52.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1806 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = 057b0c8a-f096-4bfd-8d9c-906d85c03e81 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71082025-01-17T08:36:53.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d799d4e4-145a-4c47-86ad-8f8dcac05af0 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71092025-01-17T08:36:53.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d799d4e4-145a-4c47-86ad-8f8dcac05af0 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71102025-01-17T08:36:53.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = d799d4e4-145a-4c47-86ad-8f8dcac05af0 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71112025-01-17T08:36:53.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 4ecae19e-56e0-4f5a-8ccd-50d7ac1d3930 roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
71122025-01-17T08:36:53.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 4ecae19e-56e0-4f5a-8ccd-50d7ac1d3930 resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
71132025-01-17T08:36:53.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3008 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 4ecae19e-56e0-4f5a-8ccd-50d7ac1d3930 response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?sort_by=id_ascending
71142025-01-17T08:36:53.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 229e3281-433c-432e-8fa0-18a20840128b roles = RoleSet { roles: {} } uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
71152025-01-17T08:36:53.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 229e3281-433c-432e-8fa0-18a20840128b resource = Database result = Ok(()) uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
71162025-01-17T08:36:53.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59437 req_id = 229e3281-433c-432e-8fa0-18a20840128b response_code = 200 uri = /metrics/collectors/0cc45a67-34ed-4014-ae46-f6e108da31b8/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYmFjMzM3OC03ZGFmLTRhZWYtYjBmNS1kMmNkNTI2NGYzMGUifX0%3D
71172025-01-17T08:36:53.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 505 local_addr = [fd00:1122:3344:101::a]:52478 method = GET remote_addr = [fd00:1122:3344:101::d]:62883 req_id = 8bc9dbb4-6f25-4d99-b384-586884f784f6 response_code = 200 uri = /b72586ef-ab31-4002-9c99-4f4040a5f525
71182025-01-17T08:36:54.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c10d3896-e83f-4e29-8b40-7946ba848fc1 roles = RoleSet { roles: {} } uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71192025-01-17T08:36:54.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c10d3896-e83f-4e29-8b40-7946ba848fc1 resource = Database result = Ok(()) uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e
71202025-01-17T08:36:54.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43697 req_id = c10d3896-e83f-4e29-8b40-7946ba848fc1 response_code = 200 uri = /probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e