Max level shown:
12025-06-30T23:45:03.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 703839ea-6d6d-42ad-8767-4f9dd3b45a87 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
22025-06-30T23:45:03.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 703839ea-6d6d-42ad-8767-4f9dd3b45a87 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32025-06-30T23:45:03.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 703839ea-6d6d-42ad-8767-4f9dd3b45a87 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42025-06-30T23:45:04.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c3037427-6985-4677-9404-f4c626daf1ab roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52025-06-30T23:45:04.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c3037427-6985-4677-9404-f4c626daf1ab resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62025-06-30T23:45:04.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c3037427-6985-4677-9404-f4c626daf1ab response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72025-06-30T23:45:04.321ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:34904
82025-06-30T23:45:04.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 4e3f8a85-5c06-4a71-bb48-4302452535b0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
92025-06-30T23:45:04.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 4e3f8a85-5c06-4a71-bb48-4302452535b0 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
102025-06-30T23:45:04.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 4e3f8a85-5c06-4a71-bb48-4302452535b0 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
112025-06-30T23:45:04.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 16a281aa-1727-4d9a-8ca9-2c6c7f53def1 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
122025-06-30T23:45:04.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 16a281aa-1727-4d9a-8ca9-2c6c7f53def1 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
132025-06-30T23:45:04.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 16a281aa-1727-4d9a-8ca9-2c6c7f53def1 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
142025-06-30T23:45:04.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 445 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 9accdf70-1ac7-46c3-b16f-7d725cd47313 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
152025-06-30T23:45:05.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f0f1fce1-b678-4b29-a155-cbe2be40f164 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
162025-06-30T23:45:05.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f0f1fce1-b678-4b29-a155-cbe2be40f164 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
172025-06-30T23:45:05.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f0f1fce1-b678-4b29-a155-cbe2be40f164 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
182025-06-30T23:45:06.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edc2fe58-cf74-4582-b48d-2bd206413c6b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
192025-06-30T23:45:06.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edc2fe58-cf74-4582-b48d-2bd206413c6b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
202025-06-30T23:45:06.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edc2fe58-cf74-4582-b48d-2bd206413c6b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
212025-06-30T23:45:07.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac76e9b1-0800-4f3e-949c-1b9ae9a0a83b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
222025-06-30T23:45:07.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac76e9b1-0800-4f3e-949c-1b9ae9a0a83b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
232025-06-30T23:45:07.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac76e9b1-0800-4f3e-949c-1b9ae9a0a83b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
242025-06-30T23:45:08.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5b797e7b-37b3-428a-87a0-56aa91fa68f5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
252025-06-30T23:45:08.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5b797e7b-37b3-428a-87a0-56aa91fa68f5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
262025-06-30T23:45:08.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5b797e7b-37b3-428a-87a0-56aa91fa68f5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
272025-06-30T23:45:09.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5545ffa-599f-46c4-9ae9-aa2991267efc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
282025-06-30T23:45:09.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5545ffa-599f-46c4-9ae9-aa2991267efc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
292025-06-30T23:45:09.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5545ffa-599f-46c4-9ae9-aa2991267efc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
302025-06-30T23:45:10.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f34dc02-eead-45c2-aa5e-3cd6a69f4cc7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
312025-06-30T23:45:10.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f34dc02-eead-45c2-aa5e-3cd6a69f4cc7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
322025-06-30T23:45:10.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f34dc02-eead-45c2-aa5e-3cd6a69f4cc7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
332025-06-30T23:45:11.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
342025-06-30T23:45:11.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
352025-06-30T23:45:11.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
362025-06-30T23:45:11.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
372025-06-30T23:45:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
382025-06-30T23:45:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392025-06-30T23:45:11.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402025-06-30T23:45:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
412025-06-30T23:45:11.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
422025-06-30T23:45:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
432025-06-30T23:45:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
442025-06-30T23:45:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
452025-06-30T23:45:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
462025-06-30T23:45:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
472025-06-30T23:45:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
482025-06-30T23:45:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
492025-06-30T23:45:11.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
502025-06-30T23:45:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
512025-06-30T23:45:11.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
522025-06-30T23:45:11.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.408569ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
532025-06-30T23:45:11.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.779763ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
542025-06-30T23:45:11.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42fb8e58-3dd0-4252-a480-8d3de14ac39e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
552025-06-30T23:45:11.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42fb8e58-3dd0-4252-a480-8d3de14ac39e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
562025-06-30T23:45:11.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42fb8e58-3dd0-4252-a480-8d3de14ac39e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
572025-06-30T23:45:12.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 768706c3-5352-4c11-9d9e-b833592520ae roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
582025-06-30T23:45:12.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 768706c3-5352-4c11-9d9e-b833592520ae resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
592025-06-30T23:45:12.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 768706c3-5352-4c11-9d9e-b833592520ae response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
602025-06-30T23:45:13.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9951c492-babc-4981-87ae-e21400897efc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
612025-06-30T23:45:13.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9951c492-babc-4981-87ae-e21400897efc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
622025-06-30T23:45:13.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9951c492-babc-4981-87ae-e21400897efc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
632025-06-30T23:45:14.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7283fee1-17c2-4054-95d1-bc887df60dea roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
642025-06-30T23:45:14.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7283fee1-17c2-4054-95d1-bc887df60dea resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
652025-06-30T23:45:14.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7283fee1-17c2-4054-95d1-bc887df60dea response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
662025-06-30T23:45:14.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 620 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 1fe0a143-8e51-4fcd-a252-35dac4ac3c9a response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
672025-06-30T23:45:15.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3582204-2465-42ca-b68d-379034bb8323 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
682025-06-30T23:45:15.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3582204-2465-42ca-b68d-379034bb8323 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
692025-06-30T23:45:15.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3582204-2465-42ca-b68d-379034bb8323 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
702025-06-30T23:45:16.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 556b10f8-d46b-42f7-bf7e-38bd98d32957 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
712025-06-30T23:45:16.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 556b10f8-d46b-42f7-bf7e-38bd98d32957 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
722025-06-30T23:45:16.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 556b10f8-d46b-42f7-bf7e-38bd98d32957 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
732025-06-30T23:45:17.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b39e325-ebfd-4872-88e3-54a7fac2de86 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
742025-06-30T23:45:17.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b39e325-ebfd-4872-88e3-54a7fac2de86 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
752025-06-30T23:45:17.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b39e325-ebfd-4872-88e3-54a7fac2de86 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
762025-06-30T23:45:18.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 46106b87-6fb3-4588-8762-3fe8e63ab1c7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
772025-06-30T23:45:18.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 46106b87-6fb3-4588-8762-3fe8e63ab1c7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
782025-06-30T23:45:18.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 46106b87-6fb3-4588-8762-3fe8e63ab1c7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
792025-06-30T23:45:19.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de825eb-02a3-4204-99b8-ffe07ff8fe84 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
802025-06-30T23:45:19.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de825eb-02a3-4204-99b8-ffe07ff8fe84 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
812025-06-30T23:45:19.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de825eb-02a3-4204-99b8-ffe07ff8fe84 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
822025-06-30T23:45:20.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1f01240-7b54-40b6-9f85-eedf034f5eac roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
832025-06-30T23:45:20.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1f01240-7b54-40b6-9f85-eedf034f5eac resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
842025-06-30T23:45:20.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1f01240-7b54-40b6-9f85-eedf034f5eac response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
852025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
862025-06-30T23:45:21.027ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
872025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
882025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.151\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
892025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
902025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
912025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
922025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
932025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
942025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
952025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
962025-06-30T23:45:21.027ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:35:21.027577370 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
972025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
982025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
992025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
1002025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1012025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
1022025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1032025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1042025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
1052025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
1062025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1072025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
1082025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1092025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1102025-06-30T23:45:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1112025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1122025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1132025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1142025-06-30T23:45:21.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 662793554 } })
1152025-06-30T23:45:21.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 662828995 } })
1162025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1172025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1182025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.014363ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1192025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1202025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1212025-06-30T23:45:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.185268ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1222025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
1232025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
1242025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
1252025-06-30T23:45:21.029ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
1262025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
1272025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1282025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1292025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1302025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1312025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
1322025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1332025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
1342025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
1362025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1372025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
1382025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1392025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
1402025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 7 reason = Timeout
1412025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
1422025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1432025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.24\u{b5}s iteration = 7 status = "Disabled"
1442025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
1452025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1462025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1472025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1482025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1492025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1502025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1512025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1522025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1532025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1542025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1552025-06-30T23:45:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1562025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1572025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1582025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1592025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1602025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1612025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1622025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1632025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1642025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1652025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1662025-06-30T23:45:21.030ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:35:21.027577370 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1672025-06-30T23:45:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.269606ms iteration = 4 status = {"expiration":"2025-06-30T23:35:21.027577370Z","pruned":[]}
1682025-06-30T23:45:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.521301ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1692025-06-30T23:45:21.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 665788794 } })
1702025-06-30T23:45:21.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
1712025-06-30T23:45:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1722025-06-30T23:45:21.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732025-06-30T23:45:21.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742025-06-30T23:45:21.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752025-06-30T23:45:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1762025-06-30T23:45:21.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772025-06-30T23:45:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1782025-06-30T23:45:21.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792025-06-30T23:45:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1802025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1812025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1822025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1832025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1842025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1852025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1862025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 4 reason = Timeout
1872025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
1882025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1892025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
1902025-06-30T23:45:21.037ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 4 reason = Timeout
1912025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1922025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
1932025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
1942025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1952025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
1962025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1972025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
1982025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1992025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
2002025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2012025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
2022025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
2032025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
2042025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2052025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
2062025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
2072025-06-30T23:45:21.038ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2082025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2092025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2102025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
2112025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
2122025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2132025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2142025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2152025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2162025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2172025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
2192025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2202025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2212025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
2222025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2232025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2242025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2252025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2262025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2272025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2282025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2292025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2302025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2312025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2322025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2332025-06-30T23:45:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2342025-06-30T23:45:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2352025-06-30T23:45:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2362025-06-30T23:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 7 reason = Timeout
2372025-06-30T23:45:21.040ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 674644679 } })
2382025-06-30T23:45:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2392025-06-30T23:45:21.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2402025-06-30T23:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2412025-06-30T23:45:21.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422025-06-30T23:45:21.041ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 676470221 } })
2432025-06-30T23:45:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2442025-06-30T23:45:21.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2452025-06-30T23:45:21.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
2462025-06-30T23:45:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2472025-06-30T23:45:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2482025-06-30T23:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2492025-06-30T23:45:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2502025-06-30T23:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2512025-06-30T23:45:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2522025-06-30T23:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2532025-06-30T23:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2542025-06-30T23:45:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2552025-06-30T23:45:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2562025-06-30T23:45:21.046ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 680696168 } })
2572025-06-30T23:45:21.046ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
2582025-06-30T23:45:21.047ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
2592025-06-30T23:45:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 9.91888ms iteration = 4 status = {"by_rx":{},"error":null}
2602025-06-30T23:45:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.39388ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
2612025-06-30T23:45:21.060ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2622025-06-30T23:45:21.060ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2632025-06-30T23:45:21.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2642025-06-30T23:45:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2652025-06-30T23:45:21.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2672025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2682025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2692025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2702025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2712025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2722025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2732025-06-30T23:45:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2742025-06-30T23:45:21.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2752025-06-30T23:45:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2762025-06-30T23:45:21.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2772025-06-30T23:45:21.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782025-06-30T23:45:21.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2792025-06-30T23:45:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2802025-06-30T23:45:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2812025-06-30T23:45:21.093ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2822025-06-30T23:45:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2832025-06-30T23:45:21.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2842025-06-30T23:45:21.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852025-06-30T23:45:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2862025-06-30T23:45:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2872025-06-30T23:45:21.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882025-06-30T23:45:21.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.14082ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2892025-06-30T23:45:21.098ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
2902025-06-30T23:45:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2912025-06-30T23:45:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2922025-06-30T23:45:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.927818ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2932025-06-30T23:45:21.099ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2942025-06-30T23:45:21.099ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2952025-06-30T23:45:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2962025-06-30T23:45:21.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972025-06-30T23:45:21.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2982025-06-30T23:45:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2992025-06-30T23:45:21.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002025-06-30T23:45:21.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3012025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3022025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3032025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3042025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3052025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3062025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3072025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3082025-06-30T23:45:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3092025-06-30T23:45:21.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3102025-06-30T23:45:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
3112025-06-30T23:45:21.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3122025-06-30T23:45:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 75.987878ms iteration = 3 status = {"nsuccess":5}
3132025-06-30T23:45:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3142025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3152025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3162025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3172025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3182025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3192025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3202025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3212025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 69.623581ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
3222025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3232025-06-30T23:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3242025-06-30T23:45:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3252025-06-30T23:45:21.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.753697ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
3262025-06-30T23:45:21.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3272025-06-30T23:45:21.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3282025-06-30T23:45:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3292025-06-30T23:45:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3302025-06-30T23:45:21.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3312025-06-30T23:45:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3322025-06-30T23:45:21.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3332025-06-30T23:45:21.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3342025-06-30T23:45:21.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3352025-06-30T23:45:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3362025-06-30T23:45:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3372025-06-30T23:45:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.787863ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
3382025-06-30T23:45:21.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3392025-06-30T23:45:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3402025-06-30T23:45:21.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3412025-06-30T23:45:21.115ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3422025-06-30T23:45:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3432025-06-30T23:45:21.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3442025-06-30T23:45:21.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3452025-06-30T23:45:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3462025-06-30T23:45:21.120ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3472025-06-30T23:45:21.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3482025-06-30T23:45:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3492025-06-30T23:45:21.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3502025-06-30T23:45:21.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3512025-06-30T23:45:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3522025-06-30T23:45:21.123ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3532025-06-30T23:45:21.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3542025-06-30T23:45:21.124ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3552025-06-30T23:45:21.124ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3562025-06-30T23:45:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.921851ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3572025-06-30T23:45:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3582025-06-30T23:45:21.125ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3592025-06-30T23:45:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3602025-06-30T23:45:21.127ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
3612025-06-30T23:45:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 97.867264ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3622025-06-30T23:45:21.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3632025-06-30T23:45:21.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3642025-06-30T23:45:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3652025-06-30T23:45:21.130ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
3662025-06-30T23:45:21.130ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.458617ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
3672025-06-30T23:45:21.146ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3682025-06-30T23:45:21.146ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3692025-06-30T23:45:21.146ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3702025-06-30T23:45:21.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3712025-06-30T23:45:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3722025-06-30T23:45:21.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3732025-06-30T23:45:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3742025-06-30T23:45:21.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752025-06-30T23:45:21.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3762025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3772025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3782025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3792025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3802025-06-30T23:45:21.152ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3812025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3822025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3832025-06-30T23:45:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3842025-06-30T23:45:21.153ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3852025-06-30T23:45:21.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3862025-06-30T23:45:21.153ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
3872025-06-30T23:45:21.153ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.377237ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3882025-06-30T23:45:21.154ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3892025-06-30T23:45:21.154ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3902025-06-30T23:45:21.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3912025-06-30T23:45:21.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3922025-06-30T23:45:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
3932025-06-30T23:45:21.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3942025-06-30T23:45:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3952025-06-30T23:45:21.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3962025-06-30T23:45:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.79923ms iteration = 7 status = 0
3972025-06-30T23:45:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3982025-06-30T23:45:21.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3992025-06-30T23:45:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4002025-06-30T23:45:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 130.260483ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4012025-06-30T23:45:21.169ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
4022025-06-30T23:45:21.169ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4032025-06-30T23:45:21.169ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
4042025-06-30T23:45:21.169ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.979665ms iteration = 4 status = {"generation":1}
4052025-06-30T23:45:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 132.66863ms iteration = 4 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
4062025-06-30T23:45:21.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.821782ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4072025-06-30T23:45:21.174ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4082025-06-30T23:45:21.175ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
4092025-06-30T23:45:21.175ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.308727ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
4102025-06-30T23:45:21.185ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
4112025-06-30T23:45:21.185ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.545955ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4122025-06-30T23:45:21.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4132025-06-30T23:45:21.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4142025-06-30T23:45:21.199ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4152025-06-30T23:45:21.199ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
4162025-06-30T23:45:21.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4172025-06-30T23:45:21.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4182025-06-30T23:45:21.200ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4192025-06-30T23:45:21.200ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4202025-06-30T23:45:21.200ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 161.946586ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4212025-06-30T23:45:21.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4222025-06-30T23:45:21.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4232025-06-30T23:45:21.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4242025-06-30T23:45:21.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4252025-06-30T23:45:21.205ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
4262025-06-30T23:45:21.205ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4272025-06-30T23:45:21.205ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
4282025-06-30T23:45:21.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.328245ms iteration = 4 status = {"generation":2}
4292025-06-30T23:45:21.219ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4302025-06-30T23:45:21.222ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
4312025-06-30T23:45:21.222ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4322025-06-30T23:45:21.222ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad6800ad-a7bb-45eb-a953-58f08a5c8ce2", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4332025-06-30T23:45:21.222ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4342025-06-30T23:45:21.223ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
4352025-06-30T23:45:21.243ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
4362025-06-30T23:45:21.243ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4372025-06-30T23:45:21.243ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf1d28dc-e919-4870-a4d7-5e53cd2d4dd1", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4382025-06-30T23:45:21.243ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4392025-06-30T23:45:21.244ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4402025-06-30T23:45:21.248ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 218.975115ms iteration = 9 status = {"physical_disks_added":0}
4412025-06-30T23:45:21.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cd2df455-e12c-4b82-8c17-c56787f050ba roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
4422025-06-30T23:45:21.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cd2df455-e12c-4b82-8c17-c56787f050ba resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
4432025-06-30T23:45:21.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cd2df455-e12c-4b82-8c17-c56787f050ba response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
4442025-06-30T23:45:21.336ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
4452025-06-30T23:45:21.336ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 298.833303ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4462025-06-30T23:45:21.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
4472025-06-30T23:45:21.389ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4482025-06-30T23:45:21.389ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4feaacfa-10e8-40c5-92a6-60ba47df6099", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4492025-06-30T23:45:21.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4502025-06-30T23:45:21.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4512025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4522025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
4532025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c75e69a-2e21-41ed-9185-edd9b82cacc0", "content-length": "78", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4542025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
4552025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
4562025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
4572025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "46973317-8df5-46bb-a511-4e7e0cda174c", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4582025-06-30T23:45:21.398ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4592025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
4602025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
4612025-06-30T23:45:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
4622025-06-30T23:45:21.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dd45ec7f-2034-4bcc-b96e-03e37a80b996", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4632025-06-30T23:45:21.400ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4642025-06-30T23:45:21.400ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
4652025-06-30T23:45:21.401ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
4662025-06-30T23:45:21.401ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
4672025-06-30T23:45:21.401ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4682025-06-30T23:45:21.401ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.315629ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4692025-06-30T23:45:21.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
4702025-06-30T23:45:21.403ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
4712025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
4722025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
4732025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
4742025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
4752025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
4762025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
4772025-06-30T23:45:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
4782025-06-30T23:45:21.405ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
4792025-06-30T23:45:21.405ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4802025-06-30T23:45:21.405ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7456665-ca09-4580-8857-228ee9035aea", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4812025-06-30T23:45:21.440ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
4822025-06-30T23:45:21.440ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4832025-06-30T23:45:21.440ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "283c2c4f-a08d-4e07-ba11-50f35be2fd8c", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4842025-06-30T23:45:21.444ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
4852025-06-30T23:45:21.444ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
4862025-06-30T23:45:21.444ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "062d2422-1d5a-442f-a8ab-4ba653821de2", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4872025-06-30T23:45:21.446ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 406.634837ms iteration = 7 status = {"errors":[],"sps":[]}
4882025-06-30T23:45:21.459ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4892025-06-30T23:45:21.459ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4902025-06-30T23:45:21.460ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b6dd829-c456-454f-b51d-ceba64dd362d", "content-length": "372", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4912025-06-30T23:45:21.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4922025-06-30T23:45:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4932025-06-30T23:45:21.505ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4942025-06-30T23:45:21.505ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4952025-06-30T23:45:21.505ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e40040d9-defb-4f15-8719-57238b8b8254", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
4962025-06-30T23:45:21.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4972025-06-30T23:45:21.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4982025-06-30T23:45:21.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4992025-06-30T23:45:21.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5002025-06-30T23:45:21.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5012025-06-30T23:45:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5022025-06-30T23:45:21.514ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5032025-06-30T23:45:21.514ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5042025-06-30T23:45:21.514ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "43762f97-ae64-4814-b262-01f0edf910e6", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
5052025-06-30T23:45:21.517ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 478.922129ms iteration = 7 status = {}
5062025-06-30T23:45:21.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
5072025-06-30T23:45:21.542ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5082025-06-30T23:45:21.542ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5584390-91b4-49a9-8620-7fbcdc16052f", "content-length": "691", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
5092025-06-30T23:45:21.542ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5102025-06-30T23:45:21.542ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5112025-06-30T23:45:21.542ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5122025-06-30T23:45:21.544ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 514.781668ms iteration = 7 status = {}
5132025-06-30T23:45:21.556ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 528.617868ms iteration = 7 status = {}
5142025-06-30T23:45:21.655ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5152025-06-30T23:45:21.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5162025-06-30T23:45:21.658ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 630.931296ms iteration = 7 status = null
5172025-06-30T23:45:21.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
5182025-06-30T23:45:21.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e06e88d7-ce76-4b48-a2b4-d8eca87ccf22", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5192025-06-30T23:45:21.666ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5202025-06-30T23:45:21.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5212025-06-30T23:45:21.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5222025-06-30T23:45:21.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e0003cf2-8a60-4cf8-8fe7-6a4cea7eca43", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5232025-06-30T23:45:21.668ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5242025-06-30T23:45:21.669ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e72fafab-53ba-4714-bb2e-952863950085", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5252025-06-30T23:45:21.669ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5262025-06-30T23:45:21.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
5272025-06-30T23:45:21.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5282025-06-30T23:45:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5292025-06-30T23:45:21.671ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
5302025-06-30T23:45:21.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 643.568688ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
5312025-06-30T23:45:21.684ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
5322025-06-30T23:45:21.684ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
5332025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5342025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5352025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5362025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5372025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5382025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5392025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5402025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5412025-06-30T23:45:21.685ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
5422025-06-30T23:45:21.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5432025-06-30T23:45:21.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5442025-06-30T23:45:21.687ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
5452025-06-30T23:45:21.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5462025-06-30T23:45:21.792ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e041a5e2-fae4-42a9-a31c-e45635e616fb", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
5472025-06-30T23:45:21.792ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
5482025-06-30T23:45:21.792ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5492025-06-30T23:45:21.793ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6417febe-b87d-4c1b-901e-ca71da269208", "content-length": "682", "date": "Mon, 30 Jun 2025 23:45:21 GMT"} })
5502025-06-30T23:45:21.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5512025-06-30T23:45:21.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5522025-06-30T23:45:21.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5532025-06-30T23:45:21.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5542025-06-30T23:45:21.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5552025-06-30T23:45:21.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5562025-06-30T23:45:21.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5572025-06-30T23:45:21.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5582025-06-30T23:45:21.810ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.205882ms iteration = 7 status = {}
5592025-06-30T23:45:22.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d90890fe-e14f-4a7a-9990-c048252eabd8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5602025-06-30T23:45:22.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d90890fe-e14f-4a7a-9990-c048252eabd8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5612025-06-30T23:45:22.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d90890fe-e14f-4a7a-9990-c048252eabd8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5622025-06-30T23:45:23.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c955cb9-98d3-47d0-bb5b-bf8b2e8aa743 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5632025-06-30T23:45:23.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c955cb9-98d3-47d0-bb5b-bf8b2e8aa743 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5642025-06-30T23:45:23.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c955cb9-98d3-47d0-bb5b-bf8b2e8aa743 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5652025-06-30T23:45:24.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 35ed1cf1-3f36-4827-a2a2-ba5ff882b778 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
5662025-06-30T23:45:24.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e1ec407-a432-4fce-a19a-6c7c2692318c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5672025-06-30T23:45:24.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e1ec407-a432-4fce-a19a-6c7c2692318c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5682025-06-30T23:45:24.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e1ec407-a432-4fce-a19a-6c7c2692318c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5692025-06-30T23:45:25.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b29520-c27a-41f4-85a5-f07c6b32a544 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5702025-06-30T23:45:25.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b29520-c27a-41f4-85a5-f07c6b32a544 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5712025-06-30T23:45:25.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b29520-c27a-41f4-85a5-f07c6b32a544 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5722025-06-30T23:45:26.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 622a415a-739a-4bf2-8747-d7b78f794bc2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5732025-06-30T23:45:26.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 622a415a-739a-4bf2-8747-d7b78f794bc2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5742025-06-30T23:45:26.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 622a415a-739a-4bf2-8747-d7b78f794bc2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5752025-06-30T23:45:27.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86d310be-303e-44d5-85f6-d040de31278b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5762025-06-30T23:45:27.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86d310be-303e-44d5-85f6-d040de31278b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5772025-06-30T23:45:27.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86d310be-303e-44d5-85f6-d040de31278b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5782025-06-30T23:45:28.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8d5d45d-9d32-4156-971b-c567d8f3a4f4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5792025-06-30T23:45:28.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8d5d45d-9d32-4156-971b-c567d8f3a4f4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5802025-06-30T23:45:28.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8d5d45d-9d32-4156-971b-c567d8f3a4f4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5812025-06-30T23:45:29.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0871c016-f4f5-4673-b765-9767d913e1ef roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5822025-06-30T23:45:29.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0871c016-f4f5-4673-b765-9767d913e1ef resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5832025-06-30T23:45:29.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0871c016-f4f5-4673-b765-9767d913e1ef response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5842025-06-30T23:45:30.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 316f6387-dc49-4bfb-8866-b5349cf8de55 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5852025-06-30T23:45:30.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 316f6387-dc49-4bfb-8866-b5349cf8de55 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5862025-06-30T23:45:30.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 316f6387-dc49-4bfb-8866-b5349cf8de55 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
5872025-06-30T23:45:31.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
5882025-06-30T23:45:31.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
5892025-06-30T23:45:31.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5902025-06-30T23:45:31.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5912025-06-30T23:45:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5922025-06-30T23:45:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5932025-06-30T23:45:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942025-06-30T23:45:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5952025-06-30T23:45:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5962025-06-30T23:45:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5972025-06-30T23:45:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5982025-06-30T23:45:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5992025-06-30T23:45:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002025-06-30T23:45:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
6012025-06-30T23:45:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6022025-06-30T23:45:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6032025-06-30T23:45:31.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
6042025-06-30T23:45:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.180957ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
6052025-06-30T23:45:31.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6062025-06-30T23:45:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6072025-06-30T23:45:31.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.26416ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6082025-06-30T23:45:31.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 22322555-3be3-40fe-9fd4-cfba8a073a7d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6092025-06-30T23:45:31.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 22322555-3be3-40fe-9fd4-cfba8a073a7d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6102025-06-30T23:45:31.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 22322555-3be3-40fe-9fd4-cfba8a073a7d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6112025-06-30T23:45:32.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d5edc68-5276-4c08-a393-75ec41fbfc20 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6122025-06-30T23:45:32.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d5edc68-5276-4c08-a393-75ec41fbfc20 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6132025-06-30T23:45:32.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d5edc68-5276-4c08-a393-75ec41fbfc20 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6142025-06-30T23:45:33.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 49022c4f-0a24-4480-a679-d2bbc0e6c46f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6152025-06-30T23:45:33.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 49022c4f-0a24-4480-a679-d2bbc0e6c46f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6162025-06-30T23:45:33.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 49022c4f-0a24-4480-a679-d2bbc0e6c46f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6172025-06-30T23:45:34.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 7834ea45-7d6a-4b1a-bc65-0ebf13f12b5a roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6182025-06-30T23:45:34.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 7834ea45-7d6a-4b1a-bc65-0ebf13f12b5a resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6192025-06-30T23:45:34.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 7834ea45-7d6a-4b1a-bc65-0ebf13f12b5a response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6202025-06-30T23:45:34.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 40e75573-e27d-4e63-8e7c-5da09258574f roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6212025-06-30T23:45:34.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 40e75573-e27d-4e63-8e7c-5da09258574f resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6222025-06-30T23:45:34.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 40e75573-e27d-4e63-8e7c-5da09258574f response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6232025-06-30T23:45:34.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 638 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = e07ae43b-bc0d-4b72-81af-ae6488c13179 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
6242025-06-30T23:45:34.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3acfa6-9559-4b28-ab23-710c4f076896 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6252025-06-30T23:45:34.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3acfa6-9559-4b28-ab23-710c4f076896 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6262025-06-30T23:45:34.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3acfa6-9559-4b28-ab23-710c4f076896 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6272025-06-30T23:45:35.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 767f8a74-e564-43d0-956d-13077b7cf60f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6282025-06-30T23:45:35.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 767f8a74-e564-43d0-956d-13077b7cf60f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6292025-06-30T23:45:35.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 767f8a74-e564-43d0-956d-13077b7cf60f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6302025-06-30T23:45:36.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bba58d93-ffc5-48f9-a360-a85ed5662ad1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6312025-06-30T23:45:36.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bba58d93-ffc5-48f9-a360-a85ed5662ad1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6322025-06-30T23:45:36.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bba58d93-ffc5-48f9-a360-a85ed5662ad1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6332025-06-30T23:45:37.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c623730c-7db2-4c59-9cb7-35e3a7be07b1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6342025-06-30T23:45:37.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c623730c-7db2-4c59-9cb7-35e3a7be07b1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6352025-06-30T23:45:37.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c623730c-7db2-4c59-9cb7-35e3a7be07b1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6362025-06-30T23:45:38.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207b5e2-f520-465c-be1b-d2a67f7ddead roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6372025-06-30T23:45:38.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207b5e2-f520-465c-be1b-d2a67f7ddead resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6382025-06-30T23:45:38.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207b5e2-f520-465c-be1b-d2a67f7ddead response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6392025-06-30T23:45:39.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d13b1aeb-1865-4e75-8a4d-146b5dd94675 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6402025-06-30T23:45:39.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d13b1aeb-1865-4e75-8a4d-146b5dd94675 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6412025-06-30T23:45:39.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d13b1aeb-1865-4e75-8a4d-146b5dd94675 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6422025-06-30T23:45:40.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dadf2db4-5164-41da-8449-3d31c6c13f19 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6432025-06-30T23:45:40.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dadf2db4-5164-41da-8449-3d31c6c13f19 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6442025-06-30T23:45:40.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dadf2db4-5164-41da-8449-3d31c6c13f19 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6452025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
6462025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
6472025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6482025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6492025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6502025-06-30T23:45:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512025-06-30T23:45:41.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6522025-06-30T23:45:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6532025-06-30T23:45:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6542025-06-30T23:45:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6552025-06-30T23:45:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6562025-06-30T23:45:41.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6572025-06-30T23:45:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6582025-06-30T23:45:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
6592025-06-30T23:45:41.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6602025-06-30T23:45:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6612025-06-30T23:45:41.061ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
6622025-06-30T23:45:41.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.489819ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
6632025-06-30T23:45:41.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6642025-06-30T23:45:41.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6652025-06-30T23:45:41.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.725502ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6662025-06-30T23:45:41.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39b500e7-d118-4d41-9c5a-9a7e755247bb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6672025-06-30T23:45:41.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39b500e7-d118-4d41-9c5a-9a7e755247bb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6682025-06-30T23:45:41.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39b500e7-d118-4d41-9c5a-9a7e755247bb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6692025-06-30T23:45:42.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f57493d-2daa-4222-a282-c39b3d3537ae roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6702025-06-30T23:45:42.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f57493d-2daa-4222-a282-c39b3d3537ae resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6712025-06-30T23:45:42.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f57493d-2daa-4222-a282-c39b3d3537ae response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6722025-06-30T23:45:43.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a6fb5ce-772e-42d6-bc52-f6f32e9d93e9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6732025-06-30T23:45:43.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a6fb5ce-772e-42d6-bc52-f6f32e9d93e9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6742025-06-30T23:45:43.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a6fb5ce-772e-42d6-bc52-f6f32e9d93e9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6752025-06-30T23:45:44.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 83cfb435-d7bc-4e93-8e74-1b4aa0a7aca3 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
6762025-06-30T23:45:44.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 402e9494-b6fa-4481-8cc7-024805b66d17 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6772025-06-30T23:45:44.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 402e9494-b6fa-4481-8cc7-024805b66d17 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6782025-06-30T23:45:44.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 402e9494-b6fa-4481-8cc7-024805b66d17 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6792025-06-30T23:45:45.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d3356bb-60fc-41fc-9dca-308c17b586a8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6802025-06-30T23:45:45.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d3356bb-60fc-41fc-9dca-308c17b586a8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6812025-06-30T23:45:45.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d3356bb-60fc-41fc-9dca-308c17b586a8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6822025-06-30T23:45:46.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fd8399-bfca-45d0-9a48-40af220f91e0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6832025-06-30T23:45:46.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fd8399-bfca-45d0-9a48-40af220f91e0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6842025-06-30T23:45:46.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fd8399-bfca-45d0-9a48-40af220f91e0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6852025-06-30T23:45:47.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 952a5091-476e-4fcd-a1f3-7a2694bfec95 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6862025-06-30T23:45:47.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 952a5091-476e-4fcd-a1f3-7a2694bfec95 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6872025-06-30T23:45:47.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 952a5091-476e-4fcd-a1f3-7a2694bfec95 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6882025-06-30T23:45:48.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3c966b-0503-48b8-bc87-1c6a8b1d06b4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6892025-06-30T23:45:48.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3c966b-0503-48b8-bc87-1c6a8b1d06b4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6902025-06-30T23:45:48.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cb3c966b-0503-48b8-bc87-1c6a8b1d06b4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6912025-06-30T23:45:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = f3c9547d-0614-42b5-83ef-17519249369d roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6922025-06-30T23:45:49.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = f3c9547d-0614-42b5-83ef-17519249369d resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6932025-06-30T23:45:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = f3c9547d-0614-42b5-83ef-17519249369d response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
6942025-06-30T23:45:49.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 75898a05-a687-4ebb-b859-b8821dc929ed roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6952025-06-30T23:45:49.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 75898a05-a687-4ebb-b859-b8821dc929ed resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6962025-06-30T23:45:49.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = 75898a05-a687-4ebb-b859-b8821dc929ed response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
6972025-06-30T23:45:49.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91eb48d3-d897-496d-afc6-e9f455840c66 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6982025-06-30T23:45:49.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91eb48d3-d897-496d-afc6-e9f455840c66 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
6992025-06-30T23:45:49.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91eb48d3-d897-496d-afc6-e9f455840c66 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
7002025-06-30T23:45:50.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a4bb8e7f-525d-4b67-9f09-070515e1177d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
7012025-06-30T23:45:50.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a4bb8e7f-525d-4b67-9f09-070515e1177d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
7022025-06-30T23:45:50.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a4bb8e7f-525d-4b67-9f09-070515e1177d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
7032025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
7042025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
7052025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7062025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
7072025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7082025-06-30T23:45:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7092025-06-30T23:45:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7102025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
7112025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
7122025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7132025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7142025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
7152025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
7162025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7172025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7182025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
7192025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
7202025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7212025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7222025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
7232025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7242025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
7252025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7262025-06-30T23:45:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7272025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7282025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7292025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7302025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7312025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7322025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7332025-06-30T23:45:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7342025-06-30T23:45:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 665298862 } })
7352025-06-30T23:45:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
7362025-06-30T23:45:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 666106241 } })
7372025-06-30T23:45:51.031ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.029534ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7382025-06-30T23:45:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
7392025-06-30T23:45:51.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402025-06-30T23:45:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412025-06-30T23:45:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422025-06-30T23:45:51.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7442025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7452025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7462025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7472025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7482025-06-30T23:45:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7492025-06-30T23:45:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.02396ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7502025-06-30T23:45:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7512025-06-30T23:45:51.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7522025-06-30T23:45:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7532025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
7542025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7552025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7562025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7572025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7582025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
7592025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7602025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7612025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7622025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7632025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
7642025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7652025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7662025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
7672025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7682025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7692025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7702025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
7712025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7722025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
7732025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7742025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7752025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7762025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
7772025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
7782025-06-30T23:45:51.038ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7792025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7802025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7822025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7832025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7842025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7852025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7862025-06-30T23:45:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7872025-06-30T23:45:51.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 8 reason = Timeout
7882025-06-30T23:45:51.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 674628848 } })
7892025-06-30T23:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7902025-06-30T23:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7912025-06-30T23:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7922025-06-30T23:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7932025-06-30T23:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7942025-06-30T23:45:51.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 679416449 } })
7952025-06-30T23:45:51.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
7962025-06-30T23:45:51.046ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7972025-06-30T23:45:51.046ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7982025-06-30T23:45:51.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7992025-06-30T23:45:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8002025-06-30T23:45:51.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012025-06-30T23:45:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022025-06-30T23:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
8032025-06-30T23:45:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8042025-06-30T23:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8052025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8062025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8072025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8082025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8092025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8102025-06-30T23:45:51.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112025-06-30T23:45:51.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122025-06-30T23:45:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
8132025-06-30T23:45:51.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8142025-06-30T23:45:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8152025-06-30T23:45:51.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8162025-06-30T23:45:51.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8172025-06-30T23:45:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8182025-06-30T23:45:51.076ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8192025-06-30T23:45:51.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8202025-06-30T23:45:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8212025-06-30T23:45:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8222025-06-30T23:45:51.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8232025-06-30T23:45:51.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
8242025-06-30T23:45:51.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.862151ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
8252025-06-30T23:45:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8262025-06-30T23:45:51.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8272025-06-30T23:45:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8282025-06-30T23:45:51.082ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
8292025-06-30T23:45:51.082ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 52.30955ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8302025-06-30T23:45:51.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8312025-06-30T23:45:51.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8322025-06-30T23:45:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.526469ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
8332025-06-30T23:45:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.960825ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
8342025-06-30T23:45:51.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352025-06-30T23:45:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 53.715802ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
8362025-06-30T23:45:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8372025-06-30T23:45:51.092ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8382025-06-30T23:45:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8392025-06-30T23:45:51.093ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8402025-06-30T23:45:51.093ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.539795ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8412025-06-30T23:45:51.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8422025-06-30T23:45:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8432025-06-30T23:45:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8442025-06-30T23:45:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8452025-06-30T23:45:51.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8462025-06-30T23:45:51.097ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8472025-06-30T23:45:51.097ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8482025-06-30T23:45:51.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8492025-06-30T23:45:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8502025-06-30T23:45:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8512025-06-30T23:45:51.107ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 78.123188ms iteration = 10 status = {"physical_disks_added":0}
8522025-06-30T23:45:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.421078ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8532025-06-30T23:45:51.126ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8542025-06-30T23:45:51.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8552025-06-30T23:45:51.132ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8562025-06-30T23:45:51.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8572025-06-30T23:45:51.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
8582025-06-30T23:45:51.134ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8592025-06-30T23:45:51.134ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a85c49e8-901f-4d1f-a979-9ee99ebe23e4", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
8602025-06-30T23:45:51.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8612025-06-30T23:45:51.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8622025-06-30T23:45:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.942975ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8632025-06-30T23:45:51.153ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
8642025-06-30T23:45:51.153ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad580696-f581-4251-ae36-489627dc3a69", "content-length": "78", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
8652025-06-30T23:45:51.153ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
8662025-06-30T23:45:51.153ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
8672025-06-30T23:45:51.154ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
8682025-06-30T23:45:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
8692025-06-30T23:45:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
8702025-06-30T23:45:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
8712025-06-30T23:45:51.155ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8722025-06-30T23:45:51.155ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8732025-06-30T23:45:51.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.019337ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8742025-06-30T23:45:51.156ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
8752025-06-30T23:45:51.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8762025-06-30T23:45:51.156ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
8772025-06-30T23:45:51.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
8782025-06-30T23:45:51.158ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
8792025-06-30T23:45:51.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
8802025-06-30T23:45:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
8812025-06-30T23:45:51.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8822025-06-30T23:45:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8832025-06-30T23:45:51.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
8842025-06-30T23:45:51.160ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
8852025-06-30T23:45:51.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
8862025-06-30T23:45:51.162ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 132.539546ms iteration = 8 status = 0
8872025-06-30T23:45:51.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.456162ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8882025-06-30T23:45:51.192ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
8892025-06-30T23:45:51.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
8902025-06-30T23:45:51.194ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
8912025-06-30T23:45:51.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
8922025-06-30T23:45:51.202ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
8932025-06-30T23:45:51.202ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
8942025-06-30T23:45:51.202ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e605ff4d-780d-4e53-a441-088e2522d550", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
8952025-06-30T23:45:51.204ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
8962025-06-30T23:45:51.204ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
8972025-06-30T23:45:51.204ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "ced0994c-16f6-4e31-9aff-c5d7da50ea20", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
8982025-06-30T23:45:51.235ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
8992025-06-30T23:45:51.235ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
9002025-06-30T23:45:51.235ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce519bd4-9639-492d-b963-133a3fb14d0b", "content-length": "81", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9012025-06-30T23:45:51.236ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 196.926365ms iteration = 8 status = {"errors":[],"sps":[]}
9022025-06-30T23:45:51.237ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
9032025-06-30T23:45:51.237ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9042025-06-30T23:45:51.238ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec68f1a-c034-4c42-a290-4de9f0fce9e7", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9052025-06-30T23:45:51.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9062025-06-30T23:45:51.239ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9072025-06-30T23:45:51.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9082025-06-30T23:45:51.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9092025-06-30T23:45:51.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9102025-06-30T23:45:51.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9112025-06-30T23:45:51.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9122025-06-30T23:45:51.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9132025-06-30T23:45:51.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
9142025-06-30T23:45:51.256ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9152025-06-30T23:45:51.256ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0f6d035-3c99-4073-87b7-ca5dbf6ef674", "content-length": "26", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9162025-06-30T23:45:51.256ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9172025-06-30T23:45:51.258ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
9182025-06-30T23:45:51.262ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.196791ms iteration = 8 status = {}
9192025-06-30T23:45:51.265ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9202025-06-30T23:45:51.265ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9212025-06-30T23:45:51.265ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "446ab8e3-69c8-46b6-8fc9-4aaa3509f3da", "content-length": "372", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9222025-06-30T23:45:51.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232025-06-30T23:45:51.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9242025-06-30T23:45:51.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9252025-06-30T23:45:51.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9262025-06-30T23:45:51.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9272025-06-30T23:45:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9282025-06-30T23:45:51.292ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9292025-06-30T23:45:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9302025-06-30T23:45:51.295ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.399975ms iteration = 8 status = null
9312025-06-30T23:45:51.319ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
9322025-06-30T23:45:51.319ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9332025-06-30T23:45:51.319ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bb7e3e21-08d6-4390-955e-c3ce0532d626", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9342025-06-30T23:45:51.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9352025-06-30T23:45:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9362025-06-30T23:45:51.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372025-06-30T23:45:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9382025-06-30T23:45:51.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9392025-06-30T23:45:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9402025-06-30T23:45:51.328ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9412025-06-30T23:45:51.328ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9422025-06-30T23:45:51.328ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "757b4444-1b52-40ab-97b3-7cc8b1b9b995", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9432025-06-30T23:45:51.329ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.484542ms iteration = 8 status = {}
9442025-06-30T23:45:51.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9452025-06-30T23:45:51.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9462025-06-30T23:45:51.360ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
9472025-06-30T23:45:51.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9482025-06-30T23:45:51.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9492025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
9502025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
9512025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9522025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9532025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9542025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9552025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9562025-06-30T23:45:51.374ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9572025-06-30T23:45:51.375ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9582025-06-30T23:45:51.375ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9592025-06-30T23:45:51.375ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
9602025-06-30T23:45:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9612025-06-30T23:45:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9622025-06-30T23:45:51.377ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
9632025-06-30T23:45:51.377ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9642025-06-30T23:45:51.389ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9652025-06-30T23:45:51.389ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d659ae1b-da80-4ab1-98b5-3c8b9a7d1792", "content-length": "691", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9662025-06-30T23:45:51.389ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9672025-06-30T23:45:51.389ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9682025-06-30T23:45:51.389ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9692025-06-30T23:45:51.391ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.316599ms iteration = 8 status = {}
9702025-06-30T23:45:51.479ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1d6e9f17-f0a2-4fbe-8215-d23148fbfd44", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9712025-06-30T23:45:51.479ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
9722025-06-30T23:45:51.479ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9732025-06-30T23:45:51.479ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba51ce73-01f9-489f-86a3-6d40e2579c98", "content-length": "682", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9742025-06-30T23:45:51.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9752025-06-30T23:45:51.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9762025-06-30T23:45:51.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9772025-06-30T23:45:51.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9782025-06-30T23:45:51.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9792025-06-30T23:45:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9802025-06-30T23:45:51.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9812025-06-30T23:45:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9822025-06-30T23:45:51.496ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.130557ms iteration = 8 status = {}
9832025-06-30T23:45:51.706ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 1
9842025-06-30T23:45:51.707ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
9852025-06-30T23:45:51.736ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
9862025-06-30T23:45:51.736ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50293
9872025-06-30T23:45:51.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50293 req_id = fd66bdb5-6540-4615-8a39-b1d002c22bdf roles = RoleSet { roles: {} } uri = /metrics/producers
9882025-06-30T23:45:51.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50293 req_id = fd66bdb5-6540-4615-8a39-b1d002c22bdf resource = Database result = Ok(()) uri = /metrics/producers
9892025-06-30T23:45:51.779ZINFOnexus: assigned collector to new producer collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 file = nexus/src/app/oximeter.rs:76 producer_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
9902025-06-30T23:45:51.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 42580 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50293 req_id = fd66bdb5-6540-4615-8a39-b1d002c22bdf response_code = 201 uri = /metrics/producers
9912025-06-30T23:45:51.779ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fd66bdb5-6540-4615-8a39-b1d002c22bdf", "content-length": "41", "date": "Mon, 30 Jun 2025 23:45:51 GMT"} })
9922025-06-30T23:45:51.781ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
9932025-06-30T23:45:51.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8089e32d-af75-4e4c-88c8-e67753bd130a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9942025-06-30T23:45:51.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8089e32d-af75-4e4c-88c8-e67753bd130a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9952025-06-30T23:45:51.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8089e32d-af75-4e4c-88c8-e67753bd130a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9962025-06-30T23:45:52.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf8fae1a-1e5e-424f-93c1-60fdab863ece roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9972025-06-30T23:45:52.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf8fae1a-1e5e-424f-93c1-60fdab863ece resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9982025-06-30T23:45:52.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf8fae1a-1e5e-424f-93c1-60fdab863ece response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
9992025-06-30T23:45:53.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3cf9270e-898b-4956-8c27-e114aa1144db roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10002025-06-30T23:45:53.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3cf9270e-898b-4956-8c27-e114aa1144db resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10012025-06-30T23:45:53.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3cf9270e-898b-4956-8c27-e114aa1144db response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10022025-06-30T23:45:54.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 8c32456d-2d60-4f18-a822-ba9052b1477f response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
10032025-06-30T23:45:54.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5381884e-113e-4d16-b4c1-51587571c037 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10042025-06-30T23:45:54.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5381884e-113e-4d16-b4c1-51587571c037 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10052025-06-30T23:45:54.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5381884e-113e-4d16-b4c1-51587571c037 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10062025-06-30T23:45:55.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bedae996-af52-4ea9-9c6f-67f618b211e7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10072025-06-30T23:45:55.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bedae996-af52-4ea9-9c6f-67f618b211e7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10082025-06-30T23:45:55.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bedae996-af52-4ea9-9c6f-67f618b211e7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10092025-06-30T23:45:56.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e2e0831-209d-4dd0-b8c2-04cc8ce6e56d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10102025-06-30T23:45:56.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e2e0831-209d-4dd0-b8c2-04cc8ce6e56d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10112025-06-30T23:45:56.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e2e0831-209d-4dd0-b8c2-04cc8ce6e56d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10122025-06-30T23:45:57.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c464754-237e-41d8-8265-8c4bcab98fc1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10132025-06-30T23:45:57.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c464754-237e-41d8-8265-8c4bcab98fc1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10142025-06-30T23:45:57.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c464754-237e-41d8-8265-8c4bcab98fc1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10152025-06-30T23:45:58.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50edfa33-b92c-4a81-8f64-fc14467bb5fc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10162025-06-30T23:45:58.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50edfa33-b92c-4a81-8f64-fc14467bb5fc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10172025-06-30T23:45:58.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50edfa33-b92c-4a81-8f64-fc14467bb5fc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10182025-06-30T23:45:59.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb376bdc-5165-4947-b00b-38e290b40827 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10192025-06-30T23:45:59.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb376bdc-5165-4947-b00b-38e290b40827 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10202025-06-30T23:45:59.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb376bdc-5165-4947-b00b-38e290b40827 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10212025-06-30T23:46:00.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff5c5e54-d6fd-48c5-aec0-8472ae0b5e3f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10222025-06-30T23:46:00.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff5c5e54-d6fd-48c5-aec0-8472ae0b5e3f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10232025-06-30T23:46:00.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff5c5e54-d6fd-48c5-aec0-8472ae0b5e3f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10242025-06-30T23:46:01.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
10252025-06-30T23:46:01.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10262025-06-30T23:46:01.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
10272025-06-30T23:46:01.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10282025-06-30T23:46:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10292025-06-30T23:46:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10302025-06-30T23:46:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312025-06-30T23:46:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10322025-06-30T23:46:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10332025-06-30T23:46:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10342025-06-30T23:46:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10352025-06-30T23:46:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10362025-06-30T23:46:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372025-06-30T23:46:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
10382025-06-30T23:46:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392025-06-30T23:46:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402025-06-30T23:46:01.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
10412025-06-30T23:46:01.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.993958ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
10422025-06-30T23:46:01.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10432025-06-30T23:46:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10442025-06-30T23:46:01.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.961668ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10452025-06-30T23:46:01.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45202874-b5fd-4173-90a3-31d4ea86cc3c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10462025-06-30T23:46:01.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45202874-b5fd-4173-90a3-31d4ea86cc3c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10472025-06-30T23:46:01.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45202874-b5fd-4173-90a3-31d4ea86cc3c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10482025-06-30T23:46:02.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 64f6b3d3-43c0-4ef5-a21b-82df483c695c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10492025-06-30T23:46:02.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 64f6b3d3-43c0-4ef5-a21b-82df483c695c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10502025-06-30T23:46:02.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 64f6b3d3-43c0-4ef5-a21b-82df483c695c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10512025-06-30T23:46:03.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 368bd717-7370-4cb9-86d0-2d8fbc277014 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10522025-06-30T23:46:03.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 368bd717-7370-4cb9-86d0-2d8fbc277014 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10532025-06-30T23:46:03.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 368bd717-7370-4cb9-86d0-2d8fbc277014 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10542025-06-30T23:46:04.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 6deca2ba-f51e-4688-aab7-db8b199138a1 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
10552025-06-30T23:46:04.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4bc0da4-311c-4e13-ab31-91a9bf4e46d8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10562025-06-30T23:46:04.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4bc0da4-311c-4e13-ab31-91a9bf4e46d8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10572025-06-30T23:46:04.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4bc0da4-311c-4e13-ab31-91a9bf4e46d8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10582025-06-30T23:46:06.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f94942b5-c4c1-4f5c-b968-4dc7745807a4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10592025-06-30T23:46:06.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f94942b5-c4c1-4f5c-b968-4dc7745807a4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10602025-06-30T23:46:06.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f94942b5-c4c1-4f5c-b968-4dc7745807a4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10612025-06-30T23:46:07.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d27927a-c937-436d-91e2-e3e6dfa743ad roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10622025-06-30T23:46:07.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d27927a-c937-436d-91e2-e3e6dfa743ad resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10632025-06-30T23:46:07.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d27927a-c937-436d-91e2-e3e6dfa743ad response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10642025-06-30T23:46:08.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = af12ded0-6c98-4256-afcc-f428332027e4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10652025-06-30T23:46:08.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = af12ded0-6c98-4256-afcc-f428332027e4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10662025-06-30T23:46:08.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = af12ded0-6c98-4256-afcc-f428332027e4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10672025-06-30T23:46:09.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f5740a12-33f2-442a-b641-221a1614e047 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10682025-06-30T23:46:09.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f5740a12-33f2-442a-b641-221a1614e047 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10692025-06-30T23:46:09.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f5740a12-33f2-442a-b641-221a1614e047 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10702025-06-30T23:46:10.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1026d60f-d7ee-4c10-be42-5ad9d6f563c5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10712025-06-30T23:46:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1026d60f-d7ee-4c10-be42-5ad9d6f563c5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10722025-06-30T23:46:10.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1026d60f-d7ee-4c10-be42-5ad9d6f563c5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10732025-06-30T23:46:11.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
10742025-06-30T23:46:11.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
10752025-06-30T23:46:11.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10762025-06-30T23:46:11.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10772025-06-30T23:46:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10782025-06-30T23:46:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10792025-06-30T23:46:11.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10802025-06-30T23:46:11.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10812025-06-30T23:46:11.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822025-06-30T23:46:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10832025-06-30T23:46:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10842025-06-30T23:46:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10852025-06-30T23:46:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10862025-06-30T23:46:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10872025-06-30T23:46:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882025-06-30T23:46:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
10892025-06-30T23:46:11.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10902025-06-30T23:46:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10912025-06-30T23:46:11.062ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
10922025-06-30T23:46:11.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.30957ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
10932025-06-30T23:46:11.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.209157ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10942025-06-30T23:46:11.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c3f5948-bca9-4dbb-811a-4fcbeb6aca6e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10952025-06-30T23:46:11.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c3f5948-bca9-4dbb-811a-4fcbeb6aca6e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10962025-06-30T23:46:11.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3c3f5948-bca9-4dbb-811a-4fcbeb6aca6e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10972025-06-30T23:46:12.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f848af5-c362-4c41-ace1-8cf0f6a720e7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10982025-06-30T23:46:12.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f848af5-c362-4c41-ace1-8cf0f6a720e7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
10992025-06-30T23:46:12.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f848af5-c362-4c41-ace1-8cf0f6a720e7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11002025-06-30T23:46:13.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fa8dd6a9-6e4e-4d93-8eb5-e8b8af07fbba roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11012025-06-30T23:46:13.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fa8dd6a9-6e4e-4d93-8eb5-e8b8af07fbba resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11022025-06-30T23:46:13.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fa8dd6a9-6e4e-4d93-8eb5-e8b8af07fbba response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11032025-06-30T23:46:14.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc9efce0-f562-43c8-ad10-8fce50077616 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11042025-06-30T23:46:14.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc9efce0-f562-43c8-ad10-8fce50077616 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11052025-06-30T23:46:14.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc9efce0-f562-43c8-ad10-8fce50077616 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11062025-06-30T23:46:14.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 0a77936c-628e-4dad-8d90-d563102949c0 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
11072025-06-30T23:46:15.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1336f99d-31a6-48e1-983c-db1c8fbfc49c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11082025-06-30T23:46:15.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1336f99d-31a6-48e1-983c-db1c8fbfc49c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11092025-06-30T23:46:15.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1336f99d-31a6-48e1-983c-db1c8fbfc49c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11102025-06-30T23:46:16.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edab4d88-f66f-49f5-aaa1-ffd560361a39 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11112025-06-30T23:46:16.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edab4d88-f66f-49f5-aaa1-ffd560361a39 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11122025-06-30T23:46:16.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = edab4d88-f66f-49f5-aaa1-ffd560361a39 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11132025-06-30T23:46:17.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b6be9921-da84-460d-880f-69e0d46151df roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11142025-06-30T23:46:17.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b6be9921-da84-460d-880f-69e0d46151df resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11152025-06-30T23:46:17.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b6be9921-da84-460d-880f-69e0d46151df response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11162025-06-30T23:46:18.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68ecd9f5-5f1c-4f02-a682-b8fd4699c86a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11172025-06-30T23:46:18.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68ecd9f5-5f1c-4f02-a682-b8fd4699c86a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11182025-06-30T23:46:18.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68ecd9f5-5f1c-4f02-a682-b8fd4699c86a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11192025-06-30T23:46:19.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d390ac41-924f-44fa-a481-7147647637f6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11202025-06-30T23:46:19.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d390ac41-924f-44fa-a481-7147647637f6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11212025-06-30T23:46:19.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d390ac41-924f-44fa-a481-7147647637f6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11222025-06-30T23:46:19.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = d40010ca-f7fd-42e9-800b-58c1b30f1f6f roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
11232025-06-30T23:46:19.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = d40010ca-f7fd-42e9-800b-58c1b30f1f6f resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
11242025-06-30T23:46:19.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = d40010ca-f7fd-42e9-800b-58c1b30f1f6f response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
11252025-06-30T23:46:19.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = b3eaf22b-0767-477d-879d-4d6532e1217e roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
11262025-06-30T23:46:19.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = b3eaf22b-0767-477d-879d-4d6532e1217e resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
11272025-06-30T23:46:19.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34904 req_id = b3eaf22b-0767-477d-879d-4d6532e1217e response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
11282025-06-30T23:46:20.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b8d58877-99a3-421a-ba19-feb783711ac8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11292025-06-30T23:46:20.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b8d58877-99a3-421a-ba19-feb783711ac8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11302025-06-30T23:46:20.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b8d58877-99a3-421a-ba19-feb783711ac8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
11312025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
11322025-06-30T23:46:21.027ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
11332025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
11342025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.761\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
11352025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
11362025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11372025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
11382025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11392025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
11402025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11412025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
11422025-06-30T23:46:21.027ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:36:21.027815742 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11432025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11442025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
11452025-06-30T23:46:21.027ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
11462025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11472025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11482025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
11492025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11502025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11512025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
11522025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
11532025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
11542025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11552025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11562025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11572025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11582025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11592025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11602025-06-30T23:46:21.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 663272875 } })
11612025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
11622025-06-30T23:46:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.071205ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
11632025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Timeout
11642025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
11652025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.651\u{b5}s iteration = 8 status = "Disabled"
11662025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
11672025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
11682025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11692025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11702025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
11712025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11722025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
11732025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
11742025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
11752025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11762025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11772025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11782025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
11792025-06-30T23:46:21.029ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
11802025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
11812025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11822025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
11832025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11842025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11852025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11862025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11872025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11882025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11892025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11902025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11912025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11922025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11932025-06-30T23:46:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11942025-06-30T23:46:21.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 665306792 } })
11952025-06-30T23:46:21.030ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 665456566 } })
11962025-06-30T23:46:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
11972025-06-30T23:46:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11982025-06-30T23:46:21.031ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
11992025-06-30T23:46:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.229294ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
12002025-06-30T23:46:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12012025-06-30T23:46:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12022025-06-30T23:46:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12032025-06-30T23:46:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12042025-06-30T23:46:21.032ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.602597ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12052025-06-30T23:46:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 667293378 } })
12062025-06-30T23:46:21.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12072025-06-30T23:46:21.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
12082025-06-30T23:46:21.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12092025-06-30T23:46:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12102025-06-30T23:46:21.033ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:36:21.027815742 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12112025-06-30T23:46:21.033ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.291003ms iteration = 5 status = {"expiration":"2025-06-30T23:36:21.027815742Z","pruned":[]}
12122025-06-30T23:46:21.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12132025-06-30T23:46:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12142025-06-30T23:46:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152025-06-30T23:46:21.034ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12162025-06-30T23:46:21.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12172025-06-30T23:46:21.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182025-06-30T23:46:21.036ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12192025-06-30T23:46:21.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 5 reason = Timeout
12212025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.543178ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12222025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
12232025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
12242025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12252025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 5 reason = Timeout
12262025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12272025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
12282025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12292025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
12302025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
12312025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12322025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12332025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
12342025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12352025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
12362025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12372025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
12382025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12392025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
12402025-06-30T23:46:21.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12412025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12422025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
12432025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
12442025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
12452025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12462025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
12472025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12482025-06-30T23:46:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12492025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12502025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12512025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
12522025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12532025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12542025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12552025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12562025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12572025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12582025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12592025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12602025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12612025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12622025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12632025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12642025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
12652025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12662025-06-30T23:46:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12672025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 9 reason = Timeout
12682025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12692025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12702025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12712025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12722025-06-30T23:46:21.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 674430443 } })
12732025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12742025-06-30T23:46:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12752025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12762025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12772025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12782025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12792025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802025-06-30T23:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12812025-06-30T23:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12822025-06-30T23:46:21.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832025-06-30T23:46:21.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12842025-06-30T23:46:21.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12852025-06-30T23:46:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12862025-06-30T23:46:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.64922ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
12872025-06-30T23:46:21.048ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
12882025-06-30T23:46:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 10.672557ms iteration = 5 status = {"by_rx":{},"error":null}
12892025-06-30T23:46:21.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12902025-06-30T23:46:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 686011911 } })
12912025-06-30T23:46:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12922025-06-30T23:46:21.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
12932025-06-30T23:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12942025-06-30T23:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12952025-06-30T23:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12962025-06-30T23:46:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12972025-06-30T23:46:21.074ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12982025-06-30T23:46:21.074ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
12992025-06-30T23:46:21.074ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 45.241416ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13002025-06-30T23:46:21.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012025-06-30T23:46:21.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13022025-06-30T23:46:21.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13032025-06-30T23:46:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13042025-06-30T23:46:21.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.371232ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
13062025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.31526ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
13072025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13092025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13102025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13112025-06-30T23:46:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13122025-06-30T23:46:21.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13132025-06-30T23:46:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 55.079204ms iteration = 5 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
13142025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13152025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13162025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13172025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13182025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13192025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13202025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
13212025-06-30T23:46:21.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13222025-06-30T23:46:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13232025-06-30T23:46:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13242025-06-30T23:46:21.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252025-06-30T23:46:21.099ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13262025-06-30T23:46:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13272025-06-30T23:46:21.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13282025-06-30T23:46:21.103ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.552087ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
13292025-06-30T23:46:21.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13302025-06-30T23:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13312025-06-30T23:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13322025-06-30T23:46:21.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13332025-06-30T23:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13342025-06-30T23:46:21.105ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13352025-06-30T23:46:21.105ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13362025-06-30T23:46:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.968893ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13372025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13382025-06-30T23:46:21.106ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13392025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13402025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13412025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13422025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13432025-06-30T23:46:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13442025-06-30T23:46:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13452025-06-30T23:46:21.108ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13462025-06-30T23:46:21.109ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13472025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13482025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13492025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13502025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13512025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13522025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13532025-06-30T23:46:21.109ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13542025-06-30T23:46:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13552025-06-30T23:46:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13562025-06-30T23:46:21.110ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13572025-06-30T23:46:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13582025-06-30T23:46:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.862939ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13592025-06-30T23:46:21.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13602025-06-30T23:46:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13612025-06-30T23:46:21.115ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
13622025-06-30T23:46:21.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.629434ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
13632025-06-30T23:46:21.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13642025-06-30T23:46:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13652025-06-30T23:46:21.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13662025-06-30T23:46:21.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13672025-06-30T23:46:21.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13682025-06-30T23:46:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13692025-06-30T23:46:21.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702025-06-30T23:46:21.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13712025-06-30T23:46:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13722025-06-30T23:46:21.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13732025-06-30T23:46:21.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13742025-06-30T23:46:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13752025-06-30T23:46:21.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13762025-06-30T23:46:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13772025-06-30T23:46:21.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13782025-06-30T23:46:21.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
13792025-06-30T23:46:21.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13802025-06-30T23:46:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13812025-06-30T23:46:21.147ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.719726ms iteration = 9 status = 0
13822025-06-30T23:46:21.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832025-06-30T23:46:21.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.349434ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13842025-06-30T23:46:21.149ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852025-06-30T23:46:21.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13862025-06-30T23:46:21.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13872025-06-30T23:46:21.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13882025-06-30T23:46:21.152ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13892025-06-30T23:46:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13902025-06-30T23:46:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13912025-06-30T23:46:21.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13922025-06-30T23:46:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13932025-06-30T23:46:21.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13942025-06-30T23:46:21.153ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13952025-06-30T23:46:21.153ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
13962025-06-30T23:46:21.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13972025-06-30T23:46:21.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13982025-06-30T23:46:21.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992025-06-30T23:46:21.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14002025-06-30T23:46:21.155ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14012025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14022025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14032025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14042025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14052025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14062025-06-30T23:46:21.156ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
14072025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 127.229153ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14082025-06-30T23:46:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14092025-06-30T23:46:21.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102025-06-30T23:46:21.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14112025-06-30T23:46:21.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14122025-06-30T23:46:21.159ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14132025-06-30T23:46:21.159ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14142025-06-30T23:46:21.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.337657ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14152025-06-30T23:46:21.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14162025-06-30T23:46:21.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.003123ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14172025-06-30T23:46:21.160ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14182025-06-30T23:46:21.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 122.316899ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14192025-06-30T23:46:21.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14202025-06-30T23:46:21.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14212025-06-30T23:46:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14222025-06-30T23:46:21.161ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
14232025-06-30T23:46:21.161ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14242025-06-30T23:46:21.161ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
14252025-06-30T23:46:21.161ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 133.455787ms iteration = 5 status = {"generation":2}
14262025-06-30T23:46:21.186ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14272025-06-30T23:46:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14282025-06-30T23:46:21.197ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14292025-06-30T23:46:21.197ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14302025-06-30T23:46:21.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14312025-06-30T23:46:21.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14322025-06-30T23:46:21.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332025-06-30T23:46:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14342025-06-30T23:46:21.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14352025-06-30T23:46:21.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14362025-06-30T23:46:21.204ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
14372025-06-30T23:46:21.204ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14382025-06-30T23:46:21.204ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
14392025-06-30T23:46:21.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 176.729049ms iteration = 5 status = {"generation":1}
14402025-06-30T23:46:21.206ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
14412025-06-30T23:46:21.206ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.393387ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14422025-06-30T23:46:21.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14432025-06-30T23:46:21.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14442025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
14452025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f593a83-a945-4df7-afeb-7517dc561f33", "content-length": "78", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14462025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
14472025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
14482025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
14492025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
14502025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
14512025-06-30T23:46:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
14522025-06-30T23:46:21.237ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
14532025-06-30T23:46:21.238ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
14542025-06-30T23:46:21.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
14552025-06-30T23:46:21.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
14562025-06-30T23:46:21.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
14572025-06-30T23:46:21.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
14582025-06-30T23:46:21.241ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
14592025-06-30T23:46:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
14602025-06-30T23:46:21.242ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
14612025-06-30T23:46:21.242ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14622025-06-30T23:46:21.242ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad0481e-ecff-44d7-9a98-4d299cd6674b", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14632025-06-30T23:46:21.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dabf0bc8-58cc-4c5e-9091-de40488e0c44 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
14642025-06-30T23:46:21.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dabf0bc8-58cc-4c5e-9091-de40488e0c44 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
14652025-06-30T23:46:21.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dabf0bc8-58cc-4c5e-9091-de40488e0c44 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
14662025-06-30T23:46:21.270ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.146738ms iteration = 11 status = {"physical_disks_added":0}
14672025-06-30T23:46:21.272ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
14682025-06-30T23:46:21.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
14692025-06-30T23:46:21.274ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
14702025-06-30T23:46:21.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
14712025-06-30T23:46:21.278ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
14722025-06-30T23:46:21.278ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14732025-06-30T23:46:21.279ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d29139a-ebbf-416e-97f3-08d2284ddf89", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14742025-06-30T23:46:21.316ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
14752025-06-30T23:46:21.316ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14762025-06-30T23:46:21.316ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "80b9ec66-9331-40de-8f73-e78517755c58", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14772025-06-30T23:46:21.318ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 278.993154ms iteration = 9 status = {"errors":[],"sps":[]}
14782025-06-30T23:46:21.339ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
14792025-06-30T23:46:21.339ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 301.846872ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14802025-06-30T23:46:21.408ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14812025-06-30T23:46:21.408ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53bbc41f-4ab4-450f-ab98-22975b0c2441", "content-length": "691", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14822025-06-30T23:46:21.408ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14832025-06-30T23:46:21.409ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14842025-06-30T23:46:21.409ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14852025-06-30T23:46:21.410ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.417463ms iteration = 9 status = {}
14862025-06-30T23:46:21.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14872025-06-30T23:46:21.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a68a8db1-1646-43f6-a922-6e3ec7986e51", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14882025-06-30T23:46:21.414ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14892025-06-30T23:46:21.416ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0f828a9c-faca-47d9-80c5-7ef9eed5ba0f", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14902025-06-30T23:46:21.416ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14912025-06-30T23:46:21.418ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14922025-06-30T23:46:21.418ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 390.913092ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14932025-06-30T23:46:21.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14942025-06-30T23:46:21.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14952025-06-30T23:46:21.454ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14962025-06-30T23:46:21.454ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99263779-3777-4ec6-97b6-c2cba5985dc1", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
14972025-06-30T23:46:21.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14982025-06-30T23:46:21.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14992025-06-30T23:46:21.503ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
15002025-06-30T23:46:21.503ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15012025-06-30T23:46:21.504ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a44fbeb0-08cd-4a4e-bfa3-ea0b68ddd15e", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15022025-06-30T23:46:21.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15032025-06-30T23:46:21.505ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15042025-06-30T23:46:21.508ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
15052025-06-30T23:46:21.508ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15062025-06-30T23:46:21.509ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f65bde4-e475-4da1-9412-ed2ec3fb6cb4", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15072025-06-30T23:46:21.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15082025-06-30T23:46:21.511ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
15092025-06-30T23:46:21.538ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15102025-06-30T23:46:21.538ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15112025-06-30T23:46:21.539ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb34a5b-708c-4be6-9b1e-18639c76d332", "content-length": "372", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15122025-06-30T23:46:21.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15132025-06-30T23:46:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15142025-06-30T23:46:21.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15152025-06-30T23:46:21.575ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1662cf38-e388-4cf5-8bc7-969514e09909", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15162025-06-30T23:46:21.575ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15172025-06-30T23:46:21.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7f06e792-5323-491b-9851-fc73fcfb282f", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15182025-06-30T23:46:21.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15192025-06-30T23:46:21.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2cd468da-86ff-4baa-bf1c-aaef2abe3308", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15202025-06-30T23:46:21.578ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15212025-06-30T23:46:21.580ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15222025-06-30T23:46:21.580ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 552.446059ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15232025-06-30T23:46:21.591ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15242025-06-30T23:46:21.591ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15252025-06-30T23:46:21.592ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9e557bc8-5e35-43a2-a640-3fc17dd453b0", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15262025-06-30T23:46:21.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15272025-06-30T23:46:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15282025-06-30T23:46:21.594ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15292025-06-30T23:46:21.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15302025-06-30T23:46:21.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15312025-06-30T23:46:21.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15322025-06-30T23:46:21.596ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 568.46181ms iteration = 9 status = null
15332025-06-30T23:46:21.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15342025-06-30T23:46:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15352025-06-30T23:46:21.602ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15362025-06-30T23:46:21.602ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15372025-06-30T23:46:21.602ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ab823ff-ccf9-4365-9bcf-81a36ab87e98", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15382025-06-30T23:46:21.603ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 566.015834ms iteration = 9 status = {}
15392025-06-30T23:46:21.609ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 582.044155ms iteration = 9 status = {}
15402025-06-30T23:46:21.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15412025-06-30T23:46:21.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15422025-06-30T23:46:21.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
15432025-06-30T23:46:21.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15442025-06-30T23:46:21.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15452025-06-30T23:46:21.682ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
15462025-06-30T23:46:21.682ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
15472025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15482025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15492025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15502025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15512025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15522025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15532025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15542025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15552025-06-30T23:46:21.683ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
15562025-06-30T23:46:21.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15572025-06-30T23:46:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15582025-06-30T23:46:21.685ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
15592025-06-30T23:46:21.685ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15602025-06-30T23:46:21.788ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1306e833-edff-40e7-bebb-524dfab6a2c1", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15612025-06-30T23:46:21.788ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
15622025-06-30T23:46:21.788ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15632025-06-30T23:46:21.788ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "311c4a4d-6d87-453f-9917-b85d29aa722d", "content-length": "682", "date": "Mon, 30 Jun 2025 23:46:21 GMT"} })
15642025-06-30T23:46:21.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15652025-06-30T23:46:21.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15662025-06-30T23:46:21.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15672025-06-30T23:46:21.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15682025-06-30T23:46:21.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15692025-06-30T23:46:21.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15702025-06-30T23:46:21.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15712025-06-30T23:46:21.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15722025-06-30T23:46:21.805ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 776.505784ms iteration = 9 status = {}
15732025-06-30T23:46:22.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8c2aa4b-0320-4d1e-a3c4-18800696edb4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15742025-06-30T23:46:22.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8c2aa4b-0320-4d1e-a3c4-18800696edb4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15752025-06-30T23:46:22.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8c2aa4b-0320-4d1e-a3c4-18800696edb4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15762025-06-30T23:46:23.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 511fd07a-7547-4596-be63-7e82811adde6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15772025-06-30T23:46:23.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 511fd07a-7547-4596-be63-7e82811adde6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15782025-06-30T23:46:23.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 511fd07a-7547-4596-be63-7e82811adde6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15792025-06-30T23:46:24.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3af16f16-ee84-4664-a059-b149bff5b400 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15802025-06-30T23:46:24.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3af16f16-ee84-4664-a059-b149bff5b400 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15812025-06-30T23:46:24.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3af16f16-ee84-4664-a059-b149bff5b400 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15822025-06-30T23:46:24.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 8908cce7-c2ab-4bd6-baf5-559d9dd5ca5b response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
15832025-06-30T23:46:25.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 63e2d131-c92a-47ba-b58d-c3554ff0a9e3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15842025-06-30T23:46:25.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 63e2d131-c92a-47ba-b58d-c3554ff0a9e3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15852025-06-30T23:46:25.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 63e2d131-c92a-47ba-b58d-c3554ff0a9e3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15862025-06-30T23:46:26.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 54ae1332-7bc5-486b-b515-6ed184cf5da6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15872025-06-30T23:46:26.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 54ae1332-7bc5-486b-b515-6ed184cf5da6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15882025-06-30T23:46:26.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 54ae1332-7bc5-486b-b515-6ed184cf5da6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15892025-06-30T23:46:27.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 237d6a84-46b7-4413-b5af-522343fb3aa8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15902025-06-30T23:46:27.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 237d6a84-46b7-4413-b5af-522343fb3aa8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15912025-06-30T23:46:27.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 237d6a84-46b7-4413-b5af-522343fb3aa8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15922025-06-30T23:46:28.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43ea6885-04e3-427b-9628-832ce88320e1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15932025-06-30T23:46:28.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43ea6885-04e3-427b-9628-832ce88320e1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15942025-06-30T23:46:28.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43ea6885-04e3-427b-9628-832ce88320e1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15952025-06-30T23:46:29.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c438f62-a61a-4890-8602-8372a6711b14 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15962025-06-30T23:46:29.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c438f62-a61a-4890-8602-8372a6711b14 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15972025-06-30T23:46:29.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c438f62-a61a-4890-8602-8372a6711b14 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15982025-06-30T23:46:30.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d758790-4052-47d8-b0e8-62edf21dfea5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
15992025-06-30T23:46:30.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d758790-4052-47d8-b0e8-62edf21dfea5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16002025-06-30T23:46:30.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d758790-4052-47d8-b0e8-62edf21dfea5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16012025-06-30T23:46:31.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
16022025-06-30T23:46:31.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16032025-06-30T23:46:31.030ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
16042025-06-30T23:46:31.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16052025-06-30T23:46:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16062025-06-30T23:46:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16072025-06-30T23:46:31.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16082025-06-30T23:46:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16092025-06-30T23:46:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16102025-06-30T23:46:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16112025-06-30T23:46:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16122025-06-30T23:46:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16132025-06-30T23:46:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16142025-06-30T23:46:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
16152025-06-30T23:46:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16162025-06-30T23:46:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16172025-06-30T23:46:31.059ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
16182025-06-30T23:46:31.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.219496ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
16192025-06-30T23:46:31.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16202025-06-30T23:46:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16212025-06-30T23:46:31.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.209733ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16222025-06-30T23:46:31.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 25c98b48-977e-468f-b753-2d7e8ca7ca15 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16232025-06-30T23:46:31.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 25c98b48-977e-468f-b753-2d7e8ca7ca15 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16242025-06-30T23:46:31.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 25c98b48-977e-468f-b753-2d7e8ca7ca15 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16252025-06-30T23:46:32.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 791144e6-3603-4851-8d21-ddbdefe18e9b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16262025-06-30T23:46:32.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 791144e6-3603-4851-8d21-ddbdefe18e9b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16272025-06-30T23:46:32.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 791144e6-3603-4851-8d21-ddbdefe18e9b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16282025-06-30T23:46:33.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dca0db5-d2f5-4f62-8080-307a6600e3ee roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16292025-06-30T23:46:33.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dca0db5-d2f5-4f62-8080-307a6600e3ee resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16302025-06-30T23:46:33.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dca0db5-d2f5-4f62-8080-307a6600e3ee response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16312025-06-30T23:46:34.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 547 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = fc3a01e4-8d7c-4208-8f34-4ca4c2dcc2c4 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
16322025-06-30T23:46:34.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8b18bac-0b15-4308-a4fe-09ff605cdff1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16332025-06-30T23:46:34.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8b18bac-0b15-4308-a4fe-09ff605cdff1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16342025-06-30T23:46:34.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8b18bac-0b15-4308-a4fe-09ff605cdff1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16352025-06-30T23:46:35.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2feafd80-2e06-4157-985a-bcf952a0203b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16362025-06-30T23:46:35.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2feafd80-2e06-4157-985a-bcf952a0203b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16372025-06-30T23:46:35.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2feafd80-2e06-4157-985a-bcf952a0203b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16382025-06-30T23:46:36.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e9ad2d2f-8f2d-4df0-8ade-92e5501aacac roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16392025-06-30T23:46:36.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e9ad2d2f-8f2d-4df0-8ade-92e5501aacac resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16402025-06-30T23:46:36.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e9ad2d2f-8f2d-4df0-8ade-92e5501aacac response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16412025-06-30T23:46:37.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8447b83e-ead4-422a-927e-bb6fa7df1514 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16422025-06-30T23:46:37.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8447b83e-ead4-422a-927e-bb6fa7df1514 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16432025-06-30T23:46:37.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8447b83e-ead4-422a-927e-bb6fa7df1514 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16442025-06-30T23:46:38.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 69027b4d-324c-4b74-a858-9a7aa2fc812b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16452025-06-30T23:46:38.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 69027b4d-324c-4b74-a858-9a7aa2fc812b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16462025-06-30T23:46:38.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 69027b4d-324c-4b74-a858-9a7aa2fc812b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16472025-06-30T23:46:39.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91e455cd-05e7-4094-a86c-78c75453d66d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16482025-06-30T23:46:39.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91e455cd-05e7-4094-a86c-78c75453d66d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16492025-06-30T23:46:39.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91e455cd-05e7-4094-a86c-78c75453d66d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16502025-06-30T23:46:40.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50cfbd92-5d88-47b9-a5d3-3326524b5fd1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16512025-06-30T23:46:40.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50cfbd92-5d88-47b9-a5d3-3326524b5fd1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16522025-06-30T23:46:40.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 50cfbd92-5d88-47b9-a5d3-3326524b5fd1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16532025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
16542025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
16552025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16562025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16572025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16582025-06-30T23:46:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16592025-06-30T23:46:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16602025-06-30T23:46:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16612025-06-30T23:46:41.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16622025-06-30T23:46:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16632025-06-30T23:46:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16642025-06-30T23:46:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16652025-06-30T23:46:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16662025-06-30T23:46:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16672025-06-30T23:46:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16682025-06-30T23:46:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
16692025-06-30T23:46:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16702025-06-30T23:46:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16712025-06-30T23:46:41.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
16722025-06-30T23:46:41.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.33748ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
16732025-06-30T23:46:41.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.906506ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16742025-06-30T23:46:41.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 48e40a9a-81b3-493b-9dfb-1eaa5b77eb5e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16752025-06-30T23:46:41.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 48e40a9a-81b3-493b-9dfb-1eaa5b77eb5e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16762025-06-30T23:46:41.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 48e40a9a-81b3-493b-9dfb-1eaa5b77eb5e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16772025-06-30T23:46:42.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e96406ea-849c-4549-878c-771f230b7b33 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16782025-06-30T23:46:42.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e96406ea-849c-4549-878c-771f230b7b33 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16792025-06-30T23:46:42.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e96406ea-849c-4549-878c-771f230b7b33 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16802025-06-30T23:46:43.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ccef67c-5184-4a49-a719-f5cb138dd02e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16812025-06-30T23:46:43.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ccef67c-5184-4a49-a719-f5cb138dd02e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16822025-06-30T23:46:43.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ccef67c-5184-4a49-a719-f5cb138dd02e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16832025-06-30T23:46:44.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 19ac1061-9cf1-414d-90a5-b18e64bf040f response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
16842025-06-30T23:46:44.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e620b9a-3ecf-4036-93ba-d05f0f9b70b6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16852025-06-30T23:46:44.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e620b9a-3ecf-4036-93ba-d05f0f9b70b6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16862025-06-30T23:46:44.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e620b9a-3ecf-4036-93ba-d05f0f9b70b6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16872025-06-30T23:46:45.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9dbb34ef-11ac-43ec-9747-12b38b0c8b10 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16882025-06-30T23:46:45.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9dbb34ef-11ac-43ec-9747-12b38b0c8b10 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16892025-06-30T23:46:45.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9dbb34ef-11ac-43ec-9747-12b38b0c8b10 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16902025-06-30T23:46:46.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 05e5faf0-4edd-4b40-9001-e14808eda6dc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16912025-06-30T23:46:46.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 05e5faf0-4edd-4b40-9001-e14808eda6dc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16922025-06-30T23:46:46.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 05e5faf0-4edd-4b40-9001-e14808eda6dc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16932025-06-30T23:46:47.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a7ec0ef-ffca-46f3-a5ad-5b6c6e4c2219 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16942025-06-30T23:46:47.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a7ec0ef-ffca-46f3-a5ad-5b6c6e4c2219 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16952025-06-30T23:46:47.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a7ec0ef-ffca-46f3-a5ad-5b6c6e4c2219 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16962025-06-30T23:46:48.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d2e3f7d9-c96d-43ee-a2f7-02eaa651f2e6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16972025-06-30T23:46:48.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d2e3f7d9-c96d-43ee-a2f7-02eaa651f2e6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16982025-06-30T23:46:48.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d2e3f7d9-c96d-43ee-a2f7-02eaa651f2e6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
16992025-06-30T23:46:49.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee04b0c1-c920-44e8-9112-b224b8bc4207 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17002025-06-30T23:46:49.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee04b0c1-c920-44e8-9112-b224b8bc4207 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17012025-06-30T23:46:49.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee04b0c1-c920-44e8-9112-b224b8bc4207 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17022025-06-30T23:46:50.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e888bcb5-0302-4bf3-9046-395b6ea7ca43 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17032025-06-30T23:46:50.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e888bcb5-0302-4bf3-9046-395b6ea7ca43 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17042025-06-30T23:46:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e888bcb5-0302-4bf3-9046-395b6ea7ca43 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
17052025-06-30T23:46:51.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
17062025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
17072025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
17082025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17092025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17102025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17112025-06-30T23:46:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17122025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
17132025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
17142025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
17152025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17162025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
17172025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17182025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17192025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17202025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
17212025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17222025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
17232025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17242025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
17252025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17262025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
17272025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17282025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17292025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17302025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17312025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17322025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17332025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17342025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17352025-06-30T23:46:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17362025-06-30T23:46:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 666172423 } })
17372025-06-30T23:46:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 666399428 } })
17382025-06-30T23:46:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
17392025-06-30T23:46:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
17402025-06-30T23:46:51.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17412025-06-30T23:46:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.573176ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17422025-06-30T23:46:51.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17432025-06-30T23:46:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17442025-06-30T23:46:51.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17452025-06-30T23:46:51.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462025-06-30T23:46:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17472025-06-30T23:46:51.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17482025-06-30T23:46:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.01492ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17492025-06-30T23:46:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17502025-06-30T23:46:51.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17512025-06-30T23:46:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17522025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17532025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17542025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17552025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
17562025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
17572025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17582025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17592025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
17602025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
17612025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17622025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
17632025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17642025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
17652025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17662025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
17672025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17682025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
17692025-06-30T23:46:51.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17702025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17712025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
17722025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17732025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17742025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17752025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17762025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17772025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17782025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17792025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17802025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
17812025-06-30T23:46:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17822025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17832025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17842025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17852025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17862025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17872025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17882025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17892025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17902025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17912025-06-30T23:46:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17922025-06-30T23:46:51.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932025-06-30T23:46:51.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 10 reason = Timeout
17942025-06-30T23:46:51.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.313684ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
17952025-06-30T23:46:51.040ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 675046598 } })
17962025-06-30T23:46:51.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972025-06-30T23:46:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17982025-06-30T23:46:51.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17992025-06-30T23:46:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18002025-06-30T23:46:51.042ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18012025-06-30T23:46:51.042ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18022025-06-30T23:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18032025-06-30T23:46:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18042025-06-30T23:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18052025-06-30T23:46:51.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18062025-06-30T23:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18072025-06-30T23:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18082025-06-30T23:46:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18092025-06-30T23:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18102025-06-30T23:46:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18112025-06-30T23:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18122025-06-30T23:46:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18132025-06-30T23:46:51.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 680121165 } })
18142025-06-30T23:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18152025-06-30T23:46:51.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
18162025-06-30T23:46:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18172025-06-30T23:46:51.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.898416ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18182025-06-30T23:46:51.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18192025-06-30T23:46:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18202025-06-30T23:46:51.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18212025-06-30T23:46:51.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222025-06-30T23:46:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18232025-06-30T23:46:51.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18242025-06-30T23:46:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18252025-06-30T23:46:51.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18262025-06-30T23:46:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18272025-06-30T23:46:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18282025-06-30T23:46:51.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18292025-06-30T23:46:51.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18302025-06-30T23:46:51.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18312025-06-30T23:46:51.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18322025-06-30T23:46:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18332025-06-30T23:46:51.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18342025-06-30T23:46:51.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18352025-06-30T23:46:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18362025-06-30T23:46:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.909258ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
18372025-06-30T23:46:51.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18382025-06-30T23:46:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18392025-06-30T23:46:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18402025-06-30T23:46:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18412025-06-30T23:46:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18422025-06-30T23:46:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18432025-06-30T23:46:51.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18442025-06-30T23:46:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 58.499203ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
18452025-06-30T23:46:51.096ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18462025-06-30T23:46:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18472025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18482025-06-30T23:46:51.097ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18492025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18502025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18512025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18522025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.999518ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
18532025-06-30T23:46:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18542025-06-30T23:46:51.098ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552025-06-30T23:46:51.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18562025-06-30T23:46:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18572025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
18582025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18592025-06-30T23:46:51.101ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18602025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.681334ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18612025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18622025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18632025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18642025-06-30T23:46:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18652025-06-30T23:46:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18662025-06-30T23:46:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
18672025-06-30T23:46:51.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18682025-06-30T23:46:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18692025-06-30T23:46:51.113ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.441433ms iteration = 10 status = 0
18702025-06-30T23:46:51.116ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
18712025-06-30T23:46:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.251258ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
18722025-06-30T23:46:51.136ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
18732025-06-30T23:46:51.136ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.687728ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
18742025-06-30T23:46:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.437285ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18752025-06-30T23:46:51.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18762025-06-30T23:46:51.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18772025-06-30T23:46:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.796591ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18782025-06-30T23:46:51.167ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.208767ms iteration = 12 status = {"physical_disks_added":0}
18792025-06-30T23:46:51.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
18802025-06-30T23:46:51.206ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18812025-06-30T23:46:51.207ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "097a6bec-a414-4e46-914a-0a88cd7b17c7", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
18822025-06-30T23:46:51.207ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18832025-06-30T23:46:51.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18842025-06-30T23:46:51.272ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18852025-06-30T23:46:51.272ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18862025-06-30T23:46:51.273ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef882546-68e1-4755-8567-77e6fee6f720", "content-length": "372", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
18872025-06-30T23:46:51.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18882025-06-30T23:46:51.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18892025-06-30T23:46:51.287ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18902025-06-30T23:46:51.287ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18912025-06-30T23:46:51.287ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc68b75e-8542-4251-a0ee-cf3c0fe8047e", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
18922025-06-30T23:46:51.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18932025-06-30T23:46:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18942025-06-30T23:46:51.289ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18952025-06-30T23:46:51.289ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb6646ac-ae1b-4b71-b5af-61b0df4ac567", "content-length": "691", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
18962025-06-30T23:46:51.290ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18972025-06-30T23:46:51.290ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18982025-06-30T23:46:51.290ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18992025-06-30T23:46:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19002025-06-30T23:46:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19012025-06-30T23:46:51.291ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.753385ms iteration = 10 status = {}
19022025-06-30T23:46:51.291ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
19032025-06-30T23:46:51.291ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19042025-06-30T23:46:51.292ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5319583-e762-40e1-92a8-59a36bea1cb3", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19052025-06-30T23:46:51.292ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19062025-06-30T23:46:51.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19072025-06-30T23:46:51.293ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
19082025-06-30T23:46:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19092025-06-30T23:46:51.296ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19102025-06-30T23:46:51.296ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19112025-06-30T23:46:51.296ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bd8bca0b-dec4-4fb4-a1c3-4710517554c6", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19122025-06-30T23:46:51.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 260.849654ms iteration = 10 status = {}
19132025-06-30T23:46:51.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
19142025-06-30T23:46:51.321ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19152025-06-30T23:46:51.321ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5dfb1d4-b977-4e21-998c-74285fecb3a1", "content-length": "26", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19162025-06-30T23:46:51.321ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19172025-06-30T23:46:51.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19182025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
19192025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f778983-1e99-470a-940d-52020f76b807", "content-length": "78", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19202025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
19212025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
19222025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
19232025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
19242025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
19252025-06-30T23:46:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
19262025-06-30T23:46:51.333ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
19272025-06-30T23:46:51.334ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
19282025-06-30T23:46:51.335ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
19292025-06-30T23:46:51.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
19302025-06-30T23:46:51.336ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
19312025-06-30T23:46:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
19322025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
19332025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
19342025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
19352025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
19362025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
19372025-06-30T23:46:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
19382025-06-30T23:46:51.339ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
19392025-06-30T23:46:51.339ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
19402025-06-30T23:46:51.339ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
19412025-06-30T23:46:51.339ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
19422025-06-30T23:46:51.340ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd86a200-4044-4118-abf8-bfac55f3a9a9", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19432025-06-30T23:46:51.340ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c22b9849-4b82-4357-96cf-fcaa7eb46d66", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19442025-06-30T23:46:51.365ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 337.2211ms iteration = 10 status = {}
19452025-06-30T23:46:51.374ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
19462025-06-30T23:46:51.375ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
19472025-06-30T23:46:51.375ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "656a18fc-2226-4c37-bbfc-ead19278964f", "content-length": "81", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19482025-06-30T23:46:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 337.455346ms iteration = 10 status = {"errors":[],"sps":[]}
19492025-06-30T23:46:51.457ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19502025-06-30T23:46:51.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19512025-06-30T23:46:51.459ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 431.501132ms iteration = 10 status = null
19522025-06-30T23:46:51.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19532025-06-30T23:46:51.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19542025-06-30T23:46:51.516ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
19552025-06-30T23:46:51.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19562025-06-30T23:46:51.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19572025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
19582025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
19592025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19602025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19612025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19622025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19632025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19642025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19652025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19662025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19672025-06-30T23:46:51.528ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
19682025-06-30T23:46:51.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19692025-06-30T23:46:51.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19702025-06-30T23:46:51.531ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
19712025-06-30T23:46:51.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19722025-06-30T23:46:51.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d3e99952-30d5-4e62-a72f-af4f06fb5865", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19732025-06-30T23:46:51.627ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
19742025-06-30T23:46:51.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19752025-06-30T23:46:51.628ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "26725977-da38-4184-a0b8-1fc5bf34e637", "content-length": "682", "date": "Mon, 30 Jun 2025 23:46:51 GMT"} })
19762025-06-30T23:46:51.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19772025-06-30T23:46:51.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19782025-06-30T23:46:51.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19792025-06-30T23:46:51.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19802025-06-30T23:46:51.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19812025-06-30T23:46:51.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19822025-06-30T23:46:51.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19832025-06-30T23:46:51.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19842025-06-30T23:46:51.645ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 616.398889ms iteration = 10 status = {}
19852025-06-30T23:46:51.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7d7846f9-955e-46a2-a12f-934a089c765d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19862025-06-30T23:46:51.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7d7846f9-955e-46a2-a12f-934a089c765d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19872025-06-30T23:46:51.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7d7846f9-955e-46a2-a12f-934a089c765d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19882025-06-30T23:46:52.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaefd177-a8f5-4b02-9ec3-421d6656919c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19892025-06-30T23:46:52.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaefd177-a8f5-4b02-9ec3-421d6656919c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19902025-06-30T23:46:52.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaefd177-a8f5-4b02-9ec3-421d6656919c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19912025-06-30T23:46:53.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 94264779-b0f5-49f4-8786-9d025cb431b5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19922025-06-30T23:46:53.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 94264779-b0f5-49f4-8786-9d025cb431b5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19932025-06-30T23:46:53.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 94264779-b0f5-49f4-8786-9d025cb431b5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19942025-06-30T23:46:54.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 68640b78-c8c5-4a41-9aae-88b68d7c49ee response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
19952025-06-30T23:46:54.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a60566e-50b9-40c2-94ec-58b0ddebffc3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19962025-06-30T23:46:54.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a60566e-50b9-40c2-94ec-58b0ddebffc3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19972025-06-30T23:46:54.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a60566e-50b9-40c2-94ec-58b0ddebffc3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19982025-06-30T23:46:55.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 55921c63-1f90-4641-b176-179e2432c650 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
19992025-06-30T23:46:55.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 55921c63-1f90-4641-b176-179e2432c650 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20002025-06-30T23:46:55.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 55921c63-1f90-4641-b176-179e2432c650 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20012025-06-30T23:46:56.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2a029e44-2738-4510-8d28-f5d017c72f10 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20022025-06-30T23:46:56.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2a029e44-2738-4510-8d28-f5d017c72f10 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20032025-06-30T23:46:56.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2a029e44-2738-4510-8d28-f5d017c72f10 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20042025-06-30T23:46:57.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6efa243b-a46e-4051-9dfb-deb77494018c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20052025-06-30T23:46:57.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6efa243b-a46e-4051-9dfb-deb77494018c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20062025-06-30T23:46:57.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6efa243b-a46e-4051-9dfb-deb77494018c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20072025-06-30T23:46:58.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf2e5db-039f-4367-a98b-0488bb1545e7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20082025-06-30T23:46:58.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf2e5db-039f-4367-a98b-0488bb1545e7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20092025-06-30T23:46:58.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf2e5db-039f-4367-a98b-0488bb1545e7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20102025-06-30T23:46:59.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1688fc79-58e8-4c47-a86a-021c831457e9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20112025-06-30T23:46:59.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1688fc79-58e8-4c47-a86a-021c831457e9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20122025-06-30T23:46:59.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1688fc79-58e8-4c47-a86a-021c831457e9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20132025-06-30T23:47:00.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3aa88783-be48-47e0-b955-5215f493aee2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20142025-06-30T23:47:00.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3aa88783-be48-47e0-b955-5215f493aee2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20152025-06-30T23:47:00.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3aa88783-be48-47e0-b955-5215f493aee2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20162025-06-30T23:47:01.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
20172025-06-30T23:47:01.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20182025-06-30T23:47:01.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
20192025-06-30T23:47:01.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20202025-06-30T23:47:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20212025-06-30T23:47:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20222025-06-30T23:47:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232025-06-30T23:47:01.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20242025-06-30T23:47:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20252025-06-30T23:47:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20262025-06-30T23:47:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20272025-06-30T23:47:01.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.920813ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20282025-06-30T23:47:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20292025-06-30T23:47:01.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20302025-06-30T23:47:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20312025-06-30T23:47:01.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322025-06-30T23:47:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
20332025-06-30T23:47:01.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20342025-06-30T23:47:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20352025-06-30T23:47:01.056ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
20362025-06-30T23:47:01.056ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.701928ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
20372025-06-30T23:47:01.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6487ba11-6ca5-4124-a543-4e8bced4d7a1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20382025-06-30T23:47:01.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6487ba11-6ca5-4124-a543-4e8bced4d7a1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20392025-06-30T23:47:01.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6487ba11-6ca5-4124-a543-4e8bced4d7a1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20402025-06-30T23:47:02.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef2ab9cb-f228-4bd9-808a-7e067be9a6c5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20412025-06-30T23:47:02.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef2ab9cb-f228-4bd9-808a-7e067be9a6c5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20422025-06-30T23:47:02.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef2ab9cb-f228-4bd9-808a-7e067be9a6c5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20432025-06-30T23:47:03.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cabd559b-3ab8-44ec-bd48-81f550d65814 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20442025-06-30T23:47:03.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cabd559b-3ab8-44ec-bd48-81f550d65814 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20452025-06-30T23:47:03.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cabd559b-3ab8-44ec-bd48-81f550d65814 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20462025-06-30T23:47:04.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 483 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = cd8d4ec3-9313-4c08-95b8-3eaacc5866a1 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
20472025-06-30T23:47:04.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5a6187c-b78c-4b2f-8614-910a92290634 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20482025-06-30T23:47:04.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5a6187c-b78c-4b2f-8614-910a92290634 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20492025-06-30T23:47:04.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5a6187c-b78c-4b2f-8614-910a92290634 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20502025-06-30T23:47:05.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f301ee3-140a-4d4d-aa74-5e40b7519922 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20512025-06-30T23:47:05.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f301ee3-140a-4d4d-aa74-5e40b7519922 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20522025-06-30T23:47:05.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f301ee3-140a-4d4d-aa74-5e40b7519922 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20532025-06-30T23:47:06.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cccebb3a-1ad0-45d2-b39a-2021dd942615 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20542025-06-30T23:47:06.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cccebb3a-1ad0-45d2-b39a-2021dd942615 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20552025-06-30T23:47:06.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cccebb3a-1ad0-45d2-b39a-2021dd942615 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20562025-06-30T23:47:07.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04ee5ae6-9832-475e-a604-01b5682b4bd5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20572025-06-30T23:47:07.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04ee5ae6-9832-475e-a604-01b5682b4bd5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20582025-06-30T23:47:07.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04ee5ae6-9832-475e-a604-01b5682b4bd5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20592025-06-30T23:47:09.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5a490d5-cc0d-4278-9f5d-a7577d691268 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20602025-06-30T23:47:09.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5a490d5-cc0d-4278-9f5d-a7577d691268 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20612025-06-30T23:47:09.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5a490d5-cc0d-4278-9f5d-a7577d691268 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20622025-06-30T23:47:10.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f973a79a-0891-4d9f-8843-ccc8f99d31e8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20632025-06-30T23:47:10.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f973a79a-0891-4d9f-8843-ccc8f99d31e8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20642025-06-30T23:47:10.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f973a79a-0891-4d9f-8843-ccc8f99d31e8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20652025-06-30T23:47:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
20662025-06-30T23:47:11.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20672025-06-30T23:47:11.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
20682025-06-30T23:47:11.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20692025-06-30T23:47:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20702025-06-30T23:47:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20712025-06-30T23:47:11.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20722025-06-30T23:47:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732025-06-30T23:47:11.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20742025-06-30T23:47:11.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.32877ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20752025-06-30T23:47:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20762025-06-30T23:47:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20772025-06-30T23:47:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20782025-06-30T23:47:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20792025-06-30T23:47:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20802025-06-30T23:47:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812025-06-30T23:47:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
20822025-06-30T23:47:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20832025-06-30T23:47:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20842025-06-30T23:47:11.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a25049cf-97dd-4af7-b473-8fa2b8058181 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20852025-06-30T23:47:11.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a25049cf-97dd-4af7-b473-8fa2b8058181 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20862025-06-30T23:47:11.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a25049cf-97dd-4af7-b473-8fa2b8058181 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20872025-06-30T23:47:11.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
20882025-06-30T23:47:11.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.166309ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
20892025-06-30T23:47:12.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fabb1456-ac3e-4e9c-99a1-7c3b21f8e489 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20902025-06-30T23:47:12.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fabb1456-ac3e-4e9c-99a1-7c3b21f8e489 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20912025-06-30T23:47:12.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fabb1456-ac3e-4e9c-99a1-7c3b21f8e489 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20922025-06-30T23:47:13.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 756dfabb-7522-4696-9494-0a2ab7dab88b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20932025-06-30T23:47:13.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 756dfabb-7522-4696-9494-0a2ab7dab88b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20942025-06-30T23:47:13.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 756dfabb-7522-4696-9494-0a2ab7dab88b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20952025-06-30T23:47:14.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3c23dc8-2957-4127-a405-a2f6ff1c6bfa roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20962025-06-30T23:47:14.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3c23dc8-2957-4127-a405-a2f6ff1c6bfa resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20972025-06-30T23:47:14.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3c23dc8-2957-4127-a405-a2f6ff1c6bfa response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
20982025-06-30T23:47:14.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 2b657bc3-9fca-4005-a06a-5aa0a84c9463 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
20992025-06-30T23:47:15.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28887fdc-1559-46c4-a48d-2dba49e75f86 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21002025-06-30T23:47:15.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28887fdc-1559-46c4-a48d-2dba49e75f86 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21012025-06-30T23:47:15.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28887fdc-1559-46c4-a48d-2dba49e75f86 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21022025-06-30T23:47:16.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e4fe620-58a8-4720-b0bb-7aff5f3b0305 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21032025-06-30T23:47:16.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e4fe620-58a8-4720-b0bb-7aff5f3b0305 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21042025-06-30T23:47:16.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e4fe620-58a8-4720-b0bb-7aff5f3b0305 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21052025-06-30T23:47:17.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1bbba11-a5c1-4fc5-8fd4-fff60b1d3cef roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21062025-06-30T23:47:17.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1bbba11-a5c1-4fc5-8fd4-fff60b1d3cef resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21072025-06-30T23:47:17.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1bbba11-a5c1-4fc5-8fd4-fff60b1d3cef response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21082025-06-30T23:47:18.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5fac3dc2-a4d0-4ff2-8342-d8e764fab96d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21092025-06-30T23:47:18.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5fac3dc2-a4d0-4ff2-8342-d8e764fab96d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21102025-06-30T23:47:18.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5fac3dc2-a4d0-4ff2-8342-d8e764fab96d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21112025-06-30T23:47:19.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9e2876d-f0d2-4da8-8147-0f0a7a927727 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21122025-06-30T23:47:19.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9e2876d-f0d2-4da8-8147-0f0a7a927727 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21132025-06-30T23:47:19.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9e2876d-f0d2-4da8-8147-0f0a7a927727 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21142025-06-30T23:47:20.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e664cead-f3a5-4986-9d2a-1473444288b0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21152025-06-30T23:47:20.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e664cead-f3a5-4986-9d2a-1473444288b0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21162025-06-30T23:47:20.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e664cead-f3a5-4986-9d2a-1473444288b0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
21172025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
21182025-06-30T23:47:21.027ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
21192025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.221\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
21202025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
21212025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
21222025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
21232025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21242025-06-30T23:47:21.027ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:37:21.027727816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21252025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21262025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
21272025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21282025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
21292025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21302025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21312025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21322025-06-30T23:47:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
21332025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
21342025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21352025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
21362025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
21372025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
21382025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
21392025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21402025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21412025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21422025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21432025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21442025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21452025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21462025-06-30T23:47:21.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 663603613 } })
21472025-06-30T23:47:21.028ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 663641814 } })
21482025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
21492025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
21502025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21512025-06-30T23:47:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
21522025-06-30T23:47:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
21532025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 9 reason = Timeout
21542025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
21552025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
21562025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21572025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.9\u{b5}s iteration = 9 status = "Disabled"
21582025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21592025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
21602025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
21612025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
21622025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
21632025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21642025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
21652025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21662025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21672025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21682025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
21692025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
21702025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21712025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21722025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
21732025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.442973ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
21742025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21752025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
21762025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21772025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.443113ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
21782025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
21792025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21802025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21812025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21822025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21832025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21842025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21852025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21862025-06-30T23:47:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21872025-06-30T23:47:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21882025-06-30T23:47:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21892025-06-30T23:47:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.320286ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21902025-06-30T23:47:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21912025-06-30T23:47:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21922025-06-30T23:47:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 667320669 } })
21932025-06-30T23:47:21.032ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:37:21.027727816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21942025-06-30T23:47:21.032ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.820832ms iteration = 6 status = {"expiration":"2025-06-30T23:37:21.027727816Z","pruned":[]}
21952025-06-30T23:47:21.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
21962025-06-30T23:47:21.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21972025-06-30T23:47:21.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21982025-06-30T23:47:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21992025-06-30T23:47:21.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 668456965 } })
22002025-06-30T23:47:21.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
22012025-06-30T23:47:21.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22022025-06-30T23:47:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22032025-06-30T23:47:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22042025-06-30T23:47:21.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22052025-06-30T23:47:21.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22062025-06-30T23:47:21.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22072025-06-30T23:47:21.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
22092025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
22102025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
22112025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22122025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
22132025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
22152025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
22162025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22172025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22182025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
22192025-06-30T23:47:21.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22202025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22212025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
22222025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22232025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 6 reason = Timeout
22242025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
22252025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
22262025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
22272025-06-30T23:47:21.037ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22282025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22292025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22302025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
22312025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22322025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
22332025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22342025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
22352025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22362025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
22372025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22382025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 6 reason = Timeout
22392025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
22402025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
22412025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22422025-06-30T23:47:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
22432025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
22442025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22452025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22462025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22472025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22482025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22492025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22502025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22512025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22522025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
22532025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22542025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22552025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22562025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
22572025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22582025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22592025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22602025-06-30T23:47:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22612025-06-30T23:47:21.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 11 reason = Timeout
22622025-06-30T23:47:21.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22632025-06-30T23:47:21.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 674511905 } })
22642025-06-30T23:47:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22652025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
22662025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
22672025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
22682025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22692025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22702025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22712025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22722025-06-30T23:47:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22732025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22742025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22752025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22762025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22772025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22782025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22792025-06-30T23:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22802025-06-30T23:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22812025-06-30T23:47:21.042ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22822025-06-30T23:47:21.042ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22832025-06-30T23:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22842025-06-30T23:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22852025-06-30T23:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22862025-06-30T23:47:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22872025-06-30T23:47:21.043ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
22882025-06-30T23:47:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.886736ms iteration = 6 status = {"by_rx":{},"error":null}
22892025-06-30T23:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22902025-06-30T23:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22912025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22922025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22932025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22942025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22952025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22962025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22972025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22982025-06-30T23:47:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22992025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23002025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23012025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23022025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.994125ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
23032025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23042025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23052025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23062025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23072025-06-30T23:47:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23082025-06-30T23:47:21.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23092025-06-30T23:47:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23102025-06-30T23:47:21.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23112025-06-30T23:47:21.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23122025-06-30T23:47:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23132025-06-30T23:47:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23142025-06-30T23:47:21.058ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23152025-06-30T23:47:21.058ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23162025-06-30T23:47:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.852613ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23172025-06-30T23:47:21.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
23182025-06-30T23:47:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
23192025-06-30T23:47:21.061ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23202025-06-30T23:47:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23212025-06-30T23:47:21.061ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 696888743 } })
23222025-06-30T23:47:21.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23232025-06-30T23:47:21.062ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
23242025-06-30T23:47:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23252025-06-30T23:47:21.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23262025-06-30T23:47:21.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23272025-06-30T23:47:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282025-06-30T23:47:21.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292025-06-30T23:47:21.065ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
23302025-06-30T23:47:21.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23312025-06-30T23:47:21.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23322025-06-30T23:47:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
23332025-06-30T23:47:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23342025-06-30T23:47:21.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 28.337955ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23352025-06-30T23:47:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23362025-06-30T23:47:21.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23372025-06-30T23:47:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23382025-06-30T23:47:21.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23392025-06-30T23:47:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23402025-06-30T23:47:21.093ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23412025-06-30T23:47:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23422025-06-30T23:47:21.095ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432025-06-30T23:47:21.097ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.6557ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
23442025-06-30T23:47:21.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23452025-06-30T23:47:21.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23472025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23482025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23492025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23502025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.26881ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
23512025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 62.135428ms iteration = 6 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
23522025-06-30T23:47:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23532025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23542025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23552025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23562025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23572025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23582025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23592025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23602025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23612025-06-30T23:47:21.101ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
23622025-06-30T23:47:21.101ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 72.784473ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23632025-06-30T23:47:21.102ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642025-06-30T23:47:21.102ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23652025-06-30T23:47:21.102ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
23662025-06-30T23:47:21.102ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.180264ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23672025-06-30T23:47:21.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.209039ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
23682025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23692025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23702025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
23712025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
23722025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23732025-06-30T23:47:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
23742025-06-30T23:47:21.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23752025-06-30T23:47:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23762025-06-30T23:47:21.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23772025-06-30T23:47:21.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23782025-06-30T23:47:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23792025-06-30T23:47:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23802025-06-30T23:47:21.106ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812025-06-30T23:47:21.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23822025-06-30T23:47:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23832025-06-30T23:47:21.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23842025-06-30T23:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
23852025-06-30T23:47:21.109ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
23862025-06-30T23:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
23872025-06-30T23:47:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23882025-06-30T23:47:21.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23892025-06-30T23:47:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23902025-06-30T23:47:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
23912025-06-30T23:47:21.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23922025-06-30T23:47:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23932025-06-30T23:47:21.115ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.517052ms iteration = 11 status = 0
23942025-06-30T23:47:21.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
23952025-06-30T23:47:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
23962025-06-30T23:47:21.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23972025-06-30T23:47:21.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
23982025-06-30T23:47:21.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
23992025-06-30T23:47:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24002025-06-30T23:47:21.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24012025-06-30T23:47:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24022025-06-30T23:47:21.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24032025-06-30T23:47:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24042025-06-30T23:47:21.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052025-06-30T23:47:21.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24062025-06-30T23:47:21.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24072025-06-30T23:47:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24082025-06-30T23:47:21.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24092025-06-30T23:47:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24102025-06-30T23:47:21.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-06-30T23:47:21.145ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24122025-06-30T23:47:21.145ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24132025-06-30T23:47:21.145ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24142025-06-30T23:47:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24152025-06-30T23:47:21.148ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24162025-06-30T23:47:21.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24172025-06-30T23:47:21.148ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24182025-06-30T23:47:21.148ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24192025-06-30T23:47:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.667941ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24202025-06-30T23:47:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24212025-06-30T23:47:21.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.836248ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24222025-06-30T23:47:21.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24232025-06-30T23:47:21.156ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24242025-06-30T23:47:21.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.584353ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24252025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
24262025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24272025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24282025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24292025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
24302025-06-30T23:47:21.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24312025-06-30T23:47:21.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24322025-06-30T23:47:21.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24332025-06-30T23:47:21.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24342025-06-30T23:47:21.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.594694ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24352025-06-30T23:47:21.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24362025-06-30T23:47:21.161ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372025-06-30T23:47:21.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382025-06-30T23:47:21.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24392025-06-30T23:47:21.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24402025-06-30T23:47:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24412025-06-30T23:47:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24422025-06-30T23:47:21.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24432025-06-30T23:47:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24442025-06-30T23:47:21.164ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24452025-06-30T23:47:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24462025-06-30T23:47:21.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24472025-06-30T23:47:21.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24482025-06-30T23:47:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24492025-06-30T23:47:21.166ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
24502025-06-30T23:47:21.166ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24512025-06-30T23:47:21.166ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
24522025-06-30T23:47:21.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.651837ms iteration = 6 status = {"generation":2}
24532025-06-30T23:47:21.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24542025-06-30T23:47:21.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24552025-06-30T23:47:21.167ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.940345ms iteration = 13 status = {"physical_disks_added":0}
24562025-06-30T23:47:21.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24572025-06-30T23:47:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24582025-06-30T23:47:21.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592025-06-30T23:47:21.173ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
24602025-06-30T23:47:21.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 144.296518ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
24612025-06-30T23:47:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24622025-06-30T23:47:21.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24632025-06-30T23:47:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24642025-06-30T23:47:21.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24652025-06-30T23:47:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24662025-06-30T23:47:21.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24672025-06-30T23:47:21.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24682025-06-30T23:47:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24692025-06-30T23:47:21.184ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24702025-06-30T23:47:21.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24712025-06-30T23:47:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24722025-06-30T23:47:21.185ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24732025-06-30T23:47:21.185ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24742025-06-30T23:47:21.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24752025-06-30T23:47:21.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24762025-06-30T23:47:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24772025-06-30T23:47:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24782025-06-30T23:47:21.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24792025-06-30T23:47:21.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24802025-06-30T23:47:21.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24812025-06-30T23:47:21.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24822025-06-30T23:47:21.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24832025-06-30T23:47:21.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24842025-06-30T23:47:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24852025-06-30T23:47:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24862025-06-30T23:47:21.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24872025-06-30T23:47:21.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24882025-06-30T23:47:21.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892025-06-30T23:47:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24902025-06-30T23:47:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24912025-06-30T23:47:21.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922025-06-30T23:47:21.195ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
24932025-06-30T23:47:21.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24942025-06-30T23:47:21.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24952025-06-30T23:47:21.196ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
24962025-06-30T23:47:21.196ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 158.767713ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24972025-06-30T23:47:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24982025-06-30T23:47:21.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24992025-06-30T23:47:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25002025-06-30T23:47:21.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25012025-06-30T23:47:21.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25022025-06-30T23:47:21.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25032025-06-30T23:47:21.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 163.973994ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25042025-06-30T23:47:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25052025-06-30T23:47:21.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25062025-06-30T23:47:21.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25072025-06-30T23:47:21.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25082025-06-30T23:47:21.204ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25092025-06-30T23:47:21.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25102025-06-30T23:47:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25112025-06-30T23:47:21.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25122025-06-30T23:47:21.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25132025-06-30T23:47:21.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e6a0b462-2f08-4267-9f8f-d2c8174b0783 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
25142025-06-30T23:47:21.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e6a0b462-2f08-4267-9f8f-d2c8174b0783 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
25152025-06-30T23:47:21.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162025-06-30T23:47:21.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25172025-06-30T23:47:21.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25182025-06-30T23:47:21.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e6a0b462-2f08-4267-9f8f-d2c8174b0783 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
25192025-06-30T23:47:21.214ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25202025-06-30T23:47:21.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25212025-06-30T23:47:21.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25222025-06-30T23:47:21.215ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
25232025-06-30T23:47:21.215ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 187.376964ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25242025-06-30T23:47:21.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25252025-06-30T23:47:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25262025-06-30T23:47:21.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25272025-06-30T23:47:21.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25282025-06-30T23:47:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25292025-06-30T23:47:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25302025-06-30T23:47:21.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312025-06-30T23:47:21.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25322025-06-30T23:47:21.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25332025-06-30T23:47:21.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342025-06-30T23:47:21.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25352025-06-30T23:47:21.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25362025-06-30T23:47:21.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25372025-06-30T23:47:21.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25382025-06-30T23:47:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25392025-06-30T23:47:21.222ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25402025-06-30T23:47:21.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25412025-06-30T23:47:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25422025-06-30T23:47:21.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432025-06-30T23:47:21.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442025-06-30T23:47:21.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452025-06-30T23:47:21.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25462025-06-30T23:47:21.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25472025-06-30T23:47:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25482025-06-30T23:47:21.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25492025-06-30T23:47:21.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25502025-06-30T23:47:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25512025-06-30T23:47:21.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25522025-06-30T23:47:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25532025-06-30T23:47:21.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25542025-06-30T23:47:21.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25552025-06-30T23:47:21.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25562025-06-30T23:47:21.230ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
25572025-06-30T23:47:21.230ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25582025-06-30T23:47:21.230ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
25592025-06-30T23:47:21.230ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 202.397162ms iteration = 6 status = {"generation":1}
25602025-06-30T23:47:21.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25612025-06-30T23:47:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25622025-06-30T23:47:21.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25632025-06-30T23:47:21.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25642025-06-30T23:47:21.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652025-06-30T23:47:21.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25662025-06-30T23:47:21.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25672025-06-30T23:47:21.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25682025-06-30T23:47:21.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25692025-06-30T23:47:21.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25702025-06-30T23:47:21.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25712025-06-30T23:47:21.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25722025-06-30T23:47:21.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25732025-06-30T23:47:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25742025-06-30T23:47:21.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25752025-06-30T23:47:21.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25762025-06-30T23:47:21.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25772025-06-30T23:47:21.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25782025-06-30T23:47:21.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25792025-06-30T23:47:21.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25802025-06-30T23:47:21.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25812025-06-30T23:47:21.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25822025-06-30T23:47:21.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832025-06-30T23:47:21.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25842025-06-30T23:47:21.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25852025-06-30T23:47:21.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25862025-06-30T23:47:21.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25872025-06-30T23:47:21.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25882025-06-30T23:47:21.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25892025-06-30T23:47:21.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25902025-06-30T23:47:21.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25912025-06-30T23:47:21.262ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25922025-06-30T23:47:21.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25932025-06-30T23:47:21.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25942025-06-30T23:47:21.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
25962025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "63655ddb-81d5-4242-98b1-326266903031", "content-length": "78", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
25972025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
25982025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
25992025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
26002025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
26012025-06-30T23:47:21.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
26022025-06-30T23:47:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
26032025-06-30T23:47:21.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
26042025-06-30T23:47:21.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26052025-06-30T23:47:21.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26062025-06-30T23:47:21.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26072025-06-30T23:47:21.267ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
26082025-06-30T23:47:21.267ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
26092025-06-30T23:47:21.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
26102025-06-30T23:47:21.268ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
26112025-06-30T23:47:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
26122025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
26132025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
26142025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
26152025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
26162025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
26172025-06-30T23:47:21.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
26182025-06-30T23:47:21.274ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4436a287-b8f8-4aea-ab6f-e8cb958cd3fc, kind: Service { id: a599b643-15d6-4e04-9a50-c190de356556 }, name: Name("external-dns-a599b643-15d6-4e04-9a50-c190de356556"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 81])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3cc6049-4e6b-43bb-a0b5-a817e5484933, kind: Service { id: f83c5502-8876-4c9e-ac59-0c25fb356a4f }, name: Name("external-dns-f83c5502-8876-4c9e-ac59-0c25fb356a4f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 131])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 20dc5a81-5e96-4549-bd13-7f99adcf22ee, kind: Service { id: e7a416d3-841c-4855-bc73-36f56b8a2e99 }, name: Name("nexus-e7a416d3-841c-4855-bc73-36f56b8a2e99"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 246281a8-ba14-470f-81a5-a7cd6e0cf9b3, kind: Service { id: 87bd9b06-0063-44af-ba8f-109417453f8b }, name: Name("nexus-87bd9b06-0063-44af-ba8f-109417453f8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f38fd14c-fd19-45ab-ad4d-5a4b8cbe13af, kind: Service { id: ed91cd92-bfaa-47ff-9159-b398e804895f }, name: Name("nexus-ed91cd92-bfaa-47ff-9159-b398e804895f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
26192025-06-30T23:47:21.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26202025-06-30T23:47:21.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26212025-06-30T23:47:21.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26222025-06-30T23:47:21.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
26232025-06-30T23:47:21.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26242025-06-30T23:47:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26252025-06-30T23:47:21.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26262025-06-30T23:47:21.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26272025-06-30T23:47:21.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26282025-06-30T23:47:21.282ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26292025-06-30T23:47:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26302025-06-30T23:47:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26312025-06-30T23:47:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26322025-06-30T23:47:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26332025-06-30T23:47:21.289ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26342025-06-30T23:47:21.289ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4436a287-b8f8-4aea-ab6f-e8cb958cd3fc, kind: Service { id: a599b643-15d6-4e04-9a50-c190de356556 }, name: Name("external-dns-a599b643-15d6-4e04-9a50-c190de356556"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 81])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3cc6049-4e6b-43bb-a0b5-a817e5484933, kind: Service { id: f83c5502-8876-4c9e-ac59-0c25fb356a4f }, name: Name("external-dns-f83c5502-8876-4c9e-ac59-0c25fb356a4f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 131])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 20dc5a81-5e96-4549-bd13-7f99adcf22ee, kind: Service { id: e7a416d3-841c-4855-bc73-36f56b8a2e99 }, name: Name("nexus-e7a416d3-841c-4855-bc73-36f56b8a2e99"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 246281a8-ba14-470f-81a5-a7cd6e0cf9b3, kind: Service { id: 87bd9b06-0063-44af-ba8f-109417453f8b }, name: Name("nexus-87bd9b06-0063-44af-ba8f-109417453f8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f38fd14c-fd19-45ab-ad4d-5a4b8cbe13af, kind: Service { id: ed91cd92-bfaa-47ff-9159-b398e804895f }, name: Name("nexus-ed91cd92-bfaa-47ff-9159-b398e804895f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26352025-06-30T23:47:21.289ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26362025-06-30T23:47:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26372025-06-30T23:47:21.292ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26382025-06-30T23:47:21.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26392025-06-30T23:47:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26402025-06-30T23:47:21.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26412025-06-30T23:47:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26422025-06-30T23:47:21.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26432025-06-30T23:47:21.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26442025-06-30T23:47:21.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26452025-06-30T23:47:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26462025-06-30T23:47:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26472025-06-30T23:47:21.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
26482025-06-30T23:47:21.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
26492025-06-30T23:47:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
26502025-06-30T23:47:21.308ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
26512025-06-30T23:47:21.308ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26522025-06-30T23:47:21.309ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
26532025-06-30T23:47:21.309ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a318a7e-f364-47f8-beed-82e6792af093", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26542025-06-30T23:47:21.309ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26552025-06-30T23:47:21.309ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "adf2ea58-21ed-426b-86ce-018cac573687", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26562025-06-30T23:47:21.314ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
26572025-06-30T23:47:21.314ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
26582025-06-30T23:47:21.314ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
26592025-06-30T23:47:21.316ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d78f82-6d0a-4ff8-913c-0135ec7b4ae9", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26602025-06-30T23:47:21.317ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 285.595776ms iteration = 4 status = {"blueprint_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","inventory_collection_id":"0eea6b07-fff7-4ecc-9e1d-4a6ae7ed373a","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":9,"num_not_in_inventory":0,"num_tombstoned":0}}}
26612025-06-30T23:47:21.317ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 276.816143ms iteration = 11 status = {"errors":[],"sps":[]}
26622025-06-30T23:47:21.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
26632025-06-30T23:47:21.318ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26642025-06-30T23:47:21.318ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81dcafee-f6de-425c-98ff-26bae7864d1b", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26652025-06-30T23:47:21.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26662025-06-30T23:47:21.320ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
26672025-06-30T23:47:21.343ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
26682025-06-30T23:47:21.343ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26692025-06-30T23:47:21.343ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "116d665d-737e-47e7-977b-447dd97c1b60", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26702025-06-30T23:47:21.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26712025-06-30T23:47:21.345ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26722025-06-30T23:47:21.345ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
26732025-06-30T23:47:21.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
26742025-06-30T23:47:21.347ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752025-06-30T23:47:21.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
26762025-06-30T23:47:21.349ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
26772025-06-30T23:47:21.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
26782025-06-30T23:47:21.351ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
26792025-06-30T23:47:21.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
26802025-06-30T23:47:21.353ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26812025-06-30T23:47:21.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
26822025-06-30T23:47:21.355ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
26832025-06-30T23:47:21.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
26842025-06-30T23:47:21.357ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
26852025-06-30T23:47:21.360ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "72b8e698-0802-4b96-b8e0-70e25bfb6afb", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26862025-06-30T23:47:21.363ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
26872025-06-30T23:47:21.363ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "7faa2f54-c636-455a-86c3-49e65e053d7b", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26882025-06-30T23:47:21.366ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
26892025-06-30T23:47:21.367ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 330.250799ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:47:21.360899943Z"},{"operation":"list","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:47:21.366434691Z"}]}
26902025-06-30T23:47:21.422ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e3c378dc-191c-4b79-a618-85fa0e1457c7, time_created: 2025-06-30T23:42:26.766547Z, time_modified: 2025-06-30T23:42:26.766547Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
26912025-06-30T23:47:21.422ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
26922025-06-30T23:47:21.426ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26932025-06-30T23:47:21.460ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26942025-06-30T23:47:21.460ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "975a8895-9393-4d70-9894-e63c98b00831", "content-length": "691", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
26952025-06-30T23:47:21.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26962025-06-30T23:47:21.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26972025-06-30T23:47:21.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26982025-06-30T23:47:21.460ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26992025-06-30T23:47:21.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 433.044298ms iteration = 11 status = {}
27002025-06-30T23:47:21.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
27012025-06-30T23:47:21.490ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27022025-06-30T23:47:21.490ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c01d09eb-089b-4110-92bd-d1fa7f38fa10", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27032025-06-30T23:47:21.491ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27042025-06-30T23:47:21.492ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27052025-06-30T23:47:21.565ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27062025-06-30T23:47:21.565ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27072025-06-30T23:47:21.565ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b8e2b66-9e6e-4296-846b-137086b97efb", "content-length": "372", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27082025-06-30T23:47:21.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27092025-06-30T23:47:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27102025-06-30T23:47:21.578ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27112025-06-30T23:47:21.578ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27122025-06-30T23:47:21.578ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "68c2460b-47a8-4cd9-92e7-1bdeab1f6b98", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27132025-06-30T23:47:21.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27142025-06-30T23:47:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27152025-06-30T23:47:21.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27162025-06-30T23:47:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27172025-06-30T23:47:21.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27182025-06-30T23:47:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27192025-06-30T23:47:21.588ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27202025-06-30T23:47:21.588ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27212025-06-30T23:47:21.588ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69b9eec3-cdf1-4206-9968-d5c1623642fa", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27222025-06-30T23:47:21.590ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 553.372051ms iteration = 11 status = {}
27232025-06-30T23:47:21.620ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 592.833005ms iteration = 11 status = {}
27242025-06-30T23:47:21.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27252025-06-30T23:47:21.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27262025-06-30T23:47:21.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27272025-06-30T23:47:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27282025-06-30T23:47:21.653ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27292025-06-30T23:47:21.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
27302025-06-30T23:47:21.655ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27312025-06-30T23:47:21.656ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "9a4ad8c5-68fa-4317-8893-c42ffc9aede9", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27322025-06-30T23:47:21.658ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
27332025-06-30T23:47:21.658ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 620.999706ms
27342025-06-30T23:47:21.658ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 621.006776ms iteration = 2 status = {}
27352025-06-30T23:47:21.762ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27362025-06-30T23:47:21.796ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27372025-06-30T23:47:21.797ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a981797e-b122-4a02-96d1-fa4e3543710c", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27382025-06-30T23:47:21.797ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27392025-06-30T23:47:21.798ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "00b7ee8e-60cf-4af4-ae64-b8d79b8345b9", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27402025-06-30T23:47:21.798ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27412025-06-30T23:47:21.800ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27422025-06-30T23:47:21.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 773.064994ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27432025-06-30T23:47:21.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27442025-06-30T23:47:21.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27452025-06-30T23:47:21.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
27462025-06-30T23:47:21.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27472025-06-30T23:47:21.807ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27482025-06-30T23:47:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27492025-06-30T23:47:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27502025-06-30T23:47:21.809ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 781.677403ms iteration = 11 status = null
27512025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
27522025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
27532025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27542025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27552025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27562025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27572025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27582025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27592025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27602025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27612025-06-30T23:47:21.819ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
27622025-06-30T23:47:21.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27632025-06-30T23:47:21.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27642025-06-30T23:47:21.822ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
27652025-06-30T23:47:21.822ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27662025-06-30T23:47:21.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27672025-06-30T23:47:21.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2d37324a-e1e4-40a4-b257-044752f7b931", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27682025-06-30T23:47:21.833ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27692025-06-30T23:47:21.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b6bed065-d68c-4aaf-b4c5-894982ef8938", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27702025-06-30T23:47:21.834ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27712025-06-30T23:47:21.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2f1b7636-ce65-4fba-97f3-01aebb3f0150", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27722025-06-30T23:47:21.839ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27732025-06-30T23:47:21.841ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27742025-06-30T23:47:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 814.003331ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27752025-06-30T23:47:22.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "255b2ebc-c80a-4d3e-9cd8-eaf3ddceeb2c", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27762025-06-30T23:47:22.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
27772025-06-30T23:47:22.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27782025-06-30T23:47:22.038ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f634a461-2113-4803-b9d7-47b7da51a3b9", "content-length": "682", "date": "Mon, 30 Jun 2025 23:47:21 GMT"} })
27792025-06-30T23:47:22.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27802025-06-30T23:47:22.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27812025-06-30T23:47:22.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27822025-06-30T23:47:22.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27832025-06-30T23:47:22.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27842025-06-30T23:47:22.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27852025-06-30T23:47:22.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27862025-06-30T23:47:22.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27872025-06-30T23:47:22.058ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.030000318s iteration = 11 status = {}
27882025-06-30T23:47:22.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f12da216-b906-4f10-a53f-93a947efac21 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27892025-06-30T23:47:22.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f12da216-b906-4f10-a53f-93a947efac21 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27902025-06-30T23:47:22.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f12da216-b906-4f10-a53f-93a947efac21 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27912025-06-30T23:47:23.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 73bc41ff-22f8-4cdf-bd7e-248bd6b6ff03 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27922025-06-30T23:47:23.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 73bc41ff-22f8-4cdf-bd7e-248bd6b6ff03 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27932025-06-30T23:47:23.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 73bc41ff-22f8-4cdf-bd7e-248bd6b6ff03 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27942025-06-30T23:47:24.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8ea97a-e5cb-4ac3-8cfa-c6b7095d7c03 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27952025-06-30T23:47:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8ea97a-e5cb-4ac3-8cfa-c6b7095d7c03 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27962025-06-30T23:47:24.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8ea97a-e5cb-4ac3-8cfa-c6b7095d7c03 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27972025-06-30T23:47:24.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 437 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 4826b1d5-6920-4ae0-8373-2d51a826d85c response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
27982025-06-30T23:47:25.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ab96616-fd21-4071-9adc-38c1249772a8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
27992025-06-30T23:47:25.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ab96616-fd21-4071-9adc-38c1249772a8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28002025-06-30T23:47:25.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ab96616-fd21-4071-9adc-38c1249772a8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28012025-06-30T23:47:26.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 133daa82-0d3c-4702-a95d-f41a956add18 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28022025-06-30T23:47:26.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 133daa82-0d3c-4702-a95d-f41a956add18 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28032025-06-30T23:47:26.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 133daa82-0d3c-4702-a95d-f41a956add18 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28042025-06-30T23:47:27.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86ee84ae-7ad8-4df1-a3fc-47703b82191f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28052025-06-30T23:47:27.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86ee84ae-7ad8-4df1-a3fc-47703b82191f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28062025-06-30T23:47:27.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 86ee84ae-7ad8-4df1-a3fc-47703b82191f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28072025-06-30T23:47:28.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b587d3d-c0ee-4f4a-ac3b-f5494cba12ae roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28082025-06-30T23:47:28.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b587d3d-c0ee-4f4a-ac3b-f5494cba12ae resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28092025-06-30T23:47:28.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b587d3d-c0ee-4f4a-ac3b-f5494cba12ae response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28102025-06-30T23:47:29.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3198bd8e-a60b-4e57-933f-886487399394 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28112025-06-30T23:47:29.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3198bd8e-a60b-4e57-933f-886487399394 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28122025-06-30T23:47:29.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3198bd8e-a60b-4e57-933f-886487399394 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28132025-06-30T23:47:30.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c0e35a-0e3f-421d-bc9a-4fabfd41bbb3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28142025-06-30T23:47:30.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c0e35a-0e3f-421d-bc9a-4fabfd41bbb3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28152025-06-30T23:47:30.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c0e35a-0e3f-421d-bc9a-4fabfd41bbb3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28162025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
28172025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28182025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
28192025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28202025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28212025-06-30T23:47:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28222025-06-30T23:47:31.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28232025-06-30T23:47:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28242025-06-30T23:47:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28252025-06-30T23:47:31.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.36669ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28262025-06-30T23:47:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28272025-06-30T23:47:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28282025-06-30T23:47:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28292025-06-30T23:47:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28302025-06-30T23:47:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28312025-06-30T23:47:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28322025-06-30T23:47:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
28332025-06-30T23:47:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28342025-06-30T23:47:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28352025-06-30T23:47:31.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
28362025-06-30T23:47:31.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.387424ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
28372025-06-30T23:47:31.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = abd74076-bdbf-40d5-aca3-27c0a940f7a5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28382025-06-30T23:47:31.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = abd74076-bdbf-40d5-aca3-27c0a940f7a5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28392025-06-30T23:47:31.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = abd74076-bdbf-40d5-aca3-27c0a940f7a5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28402025-06-30T23:47:32.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e5eb9af-d25b-4119-883d-64808d2e270d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28412025-06-30T23:47:32.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e5eb9af-d25b-4119-883d-64808d2e270d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28422025-06-30T23:47:32.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e5eb9af-d25b-4119-883d-64808d2e270d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28432025-06-30T23:47:33.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 674df599-95e6-4f41-bbcc-63418f9829d2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28442025-06-30T23:47:33.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 674df599-95e6-4f41-bbcc-63418f9829d2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28452025-06-30T23:47:33.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 674df599-95e6-4f41-bbcc-63418f9829d2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28462025-06-30T23:47:34.321ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:42504
28472025-06-30T23:47:34.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 1550fade-bdf7-4549-882c-c7f505eac785 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
28482025-06-30T23:47:34.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 1550fade-bdf7-4549-882c-c7f505eac785 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
28492025-06-30T23:47:34.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 1550fade-bdf7-4549-882c-c7f505eac785 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
28502025-06-30T23:47:34.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = d2781d9d-9220-4597-bd26-20807ec25dc0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
28512025-06-30T23:47:34.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = d2781d9d-9220-4597-bd26-20807ec25dc0 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
28522025-06-30T23:47:34.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = d2781d9d-9220-4597-bd26-20807ec25dc0 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
28532025-06-30T23:47:34.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 1a4794d5-cb7c-4269-a06a-8d5794366e2d response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
28542025-06-30T23:47:34.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 440e8f3b-ecad-47b3-b844-a2645ad2dc01 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28552025-06-30T23:47:34.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 440e8f3b-ecad-47b3-b844-a2645ad2dc01 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28562025-06-30T23:47:34.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 440e8f3b-ecad-47b3-b844-a2645ad2dc01 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28572025-06-30T23:47:35.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 785a70a8-9bc3-494d-9c6d-6633e6bc447e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28582025-06-30T23:47:35.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 785a70a8-9bc3-494d-9c6d-6633e6bc447e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28592025-06-30T23:47:35.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 785a70a8-9bc3-494d-9c6d-6633e6bc447e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28602025-06-30T23:47:36.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e152b0d-f49c-419d-953b-3b6504c87f09 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28612025-06-30T23:47:36.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e152b0d-f49c-419d-953b-3b6504c87f09 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28622025-06-30T23:47:36.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e152b0d-f49c-419d-953b-3b6504c87f09 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28632025-06-30T23:47:37.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6142a091-1c7b-44aa-b086-89f8baa732f6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28642025-06-30T23:47:37.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6142a091-1c7b-44aa-b086-89f8baa732f6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28652025-06-30T23:47:37.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6142a091-1c7b-44aa-b086-89f8baa732f6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28662025-06-30T23:47:38.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b4b438ff-efdf-4f07-bf71-a63bf434a094 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28672025-06-30T23:47:38.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b4b438ff-efdf-4f07-bf71-a63bf434a094 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28682025-06-30T23:47:38.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b4b438ff-efdf-4f07-bf71-a63bf434a094 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28692025-06-30T23:47:39.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17df6935-1b38-4b5b-86fa-ed78e1d78a59 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28702025-06-30T23:47:39.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17df6935-1b38-4b5b-86fa-ed78e1d78a59 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28712025-06-30T23:47:39.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17df6935-1b38-4b5b-86fa-ed78e1d78a59 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28722025-06-30T23:47:40.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 01ccef53-355f-4679-b7de-cd78671caae4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28732025-06-30T23:47:40.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 01ccef53-355f-4679-b7de-cd78671caae4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28742025-06-30T23:47:40.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 01ccef53-355f-4679-b7de-cd78671caae4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28752025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
28762025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28772025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
28782025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28792025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28802025-06-30T23:47:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28812025-06-30T23:47:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28822025-06-30T23:47:41.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28832025-06-30T23:47:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28842025-06-30T23:47:41.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.833462ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28852025-06-30T23:47:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28862025-06-30T23:47:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28872025-06-30T23:47:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28882025-06-30T23:47:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28892025-06-30T23:47:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28902025-06-30T23:47:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28912025-06-30T23:47:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
28922025-06-30T23:47:41.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28932025-06-30T23:47:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28942025-06-30T23:47:41.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
28952025-06-30T23:47:41.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.241986ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
28962025-06-30T23:47:41.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e274d364-5170-48e1-83c9-c86b3df7e906 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28972025-06-30T23:47:41.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e274d364-5170-48e1-83c9-c86b3df7e906 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28982025-06-30T23:47:41.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e274d364-5170-48e1-83c9-c86b3df7e906 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
28992025-06-30T23:47:42.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 537f2e18-7059-4d20-84d1-07fd8135b9b6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29002025-06-30T23:47:42.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 537f2e18-7059-4d20-84d1-07fd8135b9b6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29012025-06-30T23:47:42.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 537f2e18-7059-4d20-84d1-07fd8135b9b6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29022025-06-30T23:47:43.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5d3550c-da25-4a3a-b3f7-8f5d99880445 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29032025-06-30T23:47:43.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5d3550c-da25-4a3a-b3f7-8f5d99880445 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29042025-06-30T23:47:43.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d5d3550c-da25-4a3a-b3f7-8f5d99880445 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29052025-06-30T23:47:44.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 545 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = fbe9eff4-9a68-4770-9c11-f21e0dd49e5c response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
29062025-06-30T23:47:44.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a6de7d6-9211-415b-9a31-aa0e20dec2f2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29072025-06-30T23:47:44.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a6de7d6-9211-415b-9a31-aa0e20dec2f2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29082025-06-30T23:47:44.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a6de7d6-9211-415b-9a31-aa0e20dec2f2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29092025-06-30T23:47:45.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6d406376-9bce-4cb3-ae97-5c76dcbef457 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29102025-06-30T23:47:45.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6d406376-9bce-4cb3-ae97-5c76dcbef457 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29112025-06-30T23:47:45.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6d406376-9bce-4cb3-ae97-5c76dcbef457 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29122025-06-30T23:47:46.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a203e86-e612-4b6d-bd1f-51a888f3be7c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29132025-06-30T23:47:46.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a203e86-e612-4b6d-bd1f-51a888f3be7c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29142025-06-30T23:47:46.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a203e86-e612-4b6d-bd1f-51a888f3be7c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29152025-06-30T23:47:47.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0d21d306-2df7-4d04-b7b4-5a947a77d265 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29162025-06-30T23:47:47.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0d21d306-2df7-4d04-b7b4-5a947a77d265 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29172025-06-30T23:47:47.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0d21d306-2df7-4d04-b7b4-5a947a77d265 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29182025-06-30T23:47:48.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6ca2d7a-2077-4b49-8f44-3d9c4fe7dfa1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29192025-06-30T23:47:48.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6ca2d7a-2077-4b49-8f44-3d9c4fe7dfa1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29202025-06-30T23:47:48.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6ca2d7a-2077-4b49-8f44-3d9c4fe7dfa1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29212025-06-30T23:47:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = f2998190-f3f0-4505-a2f1-aa67789fade4 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
29222025-06-30T23:47:49.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = f2998190-f3f0-4505-a2f1-aa67789fade4 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
29232025-06-30T23:47:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = f2998190-f3f0-4505-a2f1-aa67789fade4 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
29242025-06-30T23:47:49.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 5b831c4b-5315-45bb-8344-02a8424c5b7d roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
29252025-06-30T23:47:49.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 5b831c4b-5315-45bb-8344-02a8424c5b7d resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
29262025-06-30T23:47:49.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 5b831c4b-5315-45bb-8344-02a8424c5b7d response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
29272025-06-30T23:47:49.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0342bf9a-face-4be5-a512-eb9a7702d9fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29282025-06-30T23:47:49.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0342bf9a-face-4be5-a512-eb9a7702d9fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29292025-06-30T23:47:49.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0342bf9a-face-4be5-a512-eb9a7702d9fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29302025-06-30T23:47:50.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 24dab3d3-e4ed-41bc-b4e2-7bb1f6a85137 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29312025-06-30T23:47:50.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 24dab3d3-e4ed-41bc-b4e2-7bb1f6a85137 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29322025-06-30T23:47:50.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 24dab3d3-e4ed-41bc-b4e2-7bb1f6a85137 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
29332025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
29342025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
29352025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
29362025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29372025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29382025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29392025-06-30T23:47:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29402025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
29412025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
29422025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
29432025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29442025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29452025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29462025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
29472025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29482025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
29492025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29502025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
29512025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
29532025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29542025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
29552025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29562025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29572025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29582025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29592025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29602025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29612025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29622025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29632025-06-30T23:47:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29642025-06-30T23:47:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 665300883 } })
29652025-06-30T23:47:51.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.072401ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29662025-06-30T23:47:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
29672025-06-30T23:47:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 666215544 } })
29682025-06-30T23:47:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
29692025-06-30T23:47:51.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29702025-06-30T23:47:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29712025-06-30T23:47:51.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722025-06-30T23:47:51.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29732025-06-30T23:47:51.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742025-06-30T23:47:51.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752025-06-30T23:47:51.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762025-06-30T23:47:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29772025-06-30T23:47:51.034ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29782025-06-30T23:47:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29792025-06-30T23:47:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.166009ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29802025-06-30T23:47:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29812025-06-30T23:47:51.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29822025-06-30T23:47:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29832025-06-30T23:47:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29842025-06-30T23:47:51.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29852025-06-30T23:47:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29862025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29872025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29882025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29892025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29912025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29922025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
29932025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
29942025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29952025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29962025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29972025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
29982025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29992025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
30002025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30012025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
30022025-06-30T23:47:51.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30032025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
30042025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30052025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30062025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
30072025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
30082025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30092025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
30102025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30112025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30122025-06-30T23:47:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
30132025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30142025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30152025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30162025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30172025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30182025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30192025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30202025-06-30T23:47:51.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30212025-06-30T23:47:51.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 12 reason = Timeout
30222025-06-30T23:47:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30232025-06-30T23:47:51.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 674559057 } })
30242025-06-30T23:47:51.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30252025-06-30T23:47:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262025-06-30T23:47:51.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 674994387 } })
30272025-06-30T23:47:51.040ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
30282025-06-30T23:47:51.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30292025-06-30T23:47:51.041ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30302025-06-30T23:47:51.041ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30312025-06-30T23:47:51.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30322025-06-30T23:47:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30332025-06-30T23:47:51.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342025-06-30T23:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30352025-06-30T23:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30362025-06-30T23:47:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30372025-06-30T23:47:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30382025-06-30T23:47:51.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30392025-06-30T23:47:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30402025-06-30T23:47:51.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30412025-06-30T23:47:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30422025-06-30T23:47:51.083ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 45.352789ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
30432025-06-30T23:47:51.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442025-06-30T23:47:51.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30452025-06-30T23:47:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30462025-06-30T23:47:51.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30472025-06-30T23:47:51.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30482025-06-30T23:47:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30492025-06-30T23:47:51.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30502025-06-30T23:47:51.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30512025-06-30T23:47:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30522025-06-30T23:47:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30532025-06-30T23:47:51.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30542025-06-30T23:47:51.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30552025-06-30T23:47:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30562025-06-30T23:47:51.095ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30572025-06-30T23:47:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30582025-06-30T23:47:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
30592025-06-30T23:47:51.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30602025-06-30T23:47:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30612025-06-30T23:47:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.324354ms iteration = 12 status = 0
30622025-06-30T23:47:51.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.448982ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
30632025-06-30T23:47:51.099ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30642025-06-30T23:47:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30652025-06-30T23:47:51.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.531449ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
30662025-06-30T23:47:51.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30672025-06-30T23:47:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30682025-06-30T23:47:51.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30692025-06-30T23:47:51.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30702025-06-30T23:47:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30712025-06-30T23:47:51.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30722025-06-30T23:47:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30732025-06-30T23:47:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
30742025-06-30T23:47:51.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30752025-06-30T23:47:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30762025-06-30T23:47:51.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30772025-06-30T23:47:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30782025-06-30T23:47:51.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.47561ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30792025-06-30T23:47:51.109ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30802025-06-30T23:47:51.109ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30812025-06-30T23:47:51.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30822025-06-30T23:47:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30832025-06-30T23:47:51.120ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
30842025-06-30T23:47:51.120ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.316313ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
30852025-06-30T23:47:51.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.756603ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30862025-06-30T23:47:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.826316ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30872025-06-30T23:47:51.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
30882025-06-30T23:47:51.141ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30892025-06-30T23:47:51.141ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22a916eb-f846-482d-b834-8a51176a2a21", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
30902025-06-30T23:47:51.141ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30912025-06-30T23:47:51.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30922025-06-30T23:47:51.144ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
30932025-06-30T23:47:51.144ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 114.833167ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30942025-06-30T23:47:51.153ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30952025-06-30T23:47:51.153ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.110026ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30962025-06-30T23:47:51.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30972025-06-30T23:47:51.174ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30982025-06-30T23:47:51.174ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30992025-06-30T23:47:51.174ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.903867ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31002025-06-30T23:47:51.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31012025-06-30T23:47:51.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31022025-06-30T23:47:51.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31032025-06-30T23:47:51.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042025-06-30T23:47:51.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
31052025-06-30T23:47:51.185ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31062025-06-30T23:47:51.186ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ba08c7a-4653-4fd0-ae1e-f430511de94c", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31072025-06-30T23:47:51.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31082025-06-30T23:47:51.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31092025-06-30T23:47:51.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31102025-06-30T23:47:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31112025-06-30T23:47:51.187ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.872062ms iteration = 14 status = {"physical_disks_added":0}
31122025-06-30T23:47:51.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
31132025-06-30T23:47:51.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31142025-06-30T23:47:51.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31152025-06-30T23:47:51.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31162025-06-30T23:47:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31172025-06-30T23:47:51.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
31182025-06-30T23:47:51.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31192025-06-30T23:47:51.283ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05738143-b077-4c1b-9ec7-da8d8b3067f9", "content-length": "26", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31202025-06-30T23:47:51.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31212025-06-30T23:47:51.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31222025-06-30T23:47:51.306ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
31232025-06-30T23:47:51.306ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b46f8c6-931d-4a40-a558-dc75b4082065", "content-length": "78", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31242025-06-30T23:47:51.306ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
31252025-06-30T23:47:51.306ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
31262025-06-30T23:47:51.306ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
31272025-06-30T23:47:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
31282025-06-30T23:47:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
31292025-06-30T23:47:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
31302025-06-30T23:47:51.308ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
31312025-06-30T23:47:51.309ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
31322025-06-30T23:47:51.309ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
31332025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
31342025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
31352025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
31362025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
31372025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
31382025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
31392025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
31402025-06-30T23:47:51.312ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
31412025-06-30T23:47:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
31422025-06-30T23:47:51.315ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
31432025-06-30T23:47:51.315ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
31442025-06-30T23:47:51.315ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dd73539-dbe8-4ae7-9c25-3f352b53d7b8", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31452025-06-30T23:47:51.334ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31462025-06-30T23:47:51.334ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31472025-06-30T23:47:51.334ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd4eb0f5-daf5-490e-a5f7-ee3e78396256", "content-length": "372", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31482025-06-30T23:47:51.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31492025-06-30T23:47:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31502025-06-30T23:47:51.347ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
31512025-06-30T23:47:51.347ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
31522025-06-30T23:47:51.347ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd58b69d-24d2-43f5-ba8b-90d0a709f694", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31532025-06-30T23:47:51.348ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
31542025-06-30T23:47:51.348ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
31552025-06-30T23:47:51.349ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e26c06c-fd96-4893-9b10-da0bcbaeebec", "content-length": "81", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31562025-06-30T23:47:51.349ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31572025-06-30T23:47:51.349ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31582025-06-30T23:47:51.349ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8ed6fe6b-9cfa-41e0-b317-67a733e0b231", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31592025-06-30T23:47:51.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31602025-06-30T23:47:51.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31612025-06-30T23:47:51.350ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 311.752792ms iteration = 12 status = {"errors":[],"sps":[]}
31622025-06-30T23:47:51.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31632025-06-30T23:47:51.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31642025-06-30T23:47:51.354ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31652025-06-30T23:47:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31662025-06-30T23:47:51.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31672025-06-30T23:47:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31682025-06-30T23:47:51.356ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.511803ms iteration = 12 status = null
31692025-06-30T23:47:51.358ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31702025-06-30T23:47:51.358ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31712025-06-30T23:47:51.358ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e486ffb-2098-48cd-95c7-ec95d5a44e22", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31722025-06-30T23:47:51.360ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.046983ms iteration = 12 status = {}
31732025-06-30T23:47:51.378ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31742025-06-30T23:47:51.378ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "69aeec78-632a-4b7c-834c-8088b8b5416a", "content-length": "691", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
31752025-06-30T23:47:51.378ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31762025-06-30T23:47:51.378ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31772025-06-30T23:47:51.379ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31782025-06-30T23:47:51.381ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.712556ms iteration = 12 status = {}
31792025-06-30T23:47:51.388ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.94716ms iteration = 12 status = {}
31802025-06-30T23:47:51.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31812025-06-30T23:47:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31822025-06-30T23:47:51.433ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
31832025-06-30T23:47:51.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31842025-06-30T23:47:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31852025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
31862025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
31872025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31882025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31892025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31902025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31912025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31922025-06-30T23:47:51.445ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31932025-06-30T23:47:51.446ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31942025-06-30T23:47:51.446ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31952025-06-30T23:47:51.446ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
31962025-06-30T23:47:51.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31972025-06-30T23:47:51.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31982025-06-30T23:47:51.449ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
31992025-06-30T23:47:51.449ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32002025-06-30T23:47:51.545ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e4ba4ec5-df39-4022-8366-d907b173a9b0", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
32012025-06-30T23:47:51.545ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
32022025-06-30T23:47:51.545ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32032025-06-30T23:47:51.545ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "69ad9826-a541-442d-829d-1c0bf3f42d21", "content-length": "682", "date": "Mon, 30 Jun 2025 23:47:51 GMT"} })
32042025-06-30T23:47:51.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32052025-06-30T23:47:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32062025-06-30T23:47:51.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32072025-06-30T23:47:51.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32082025-06-30T23:47:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32092025-06-30T23:47:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32102025-06-30T23:47:51.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32112025-06-30T23:47:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32122025-06-30T23:47:51.563ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.228178ms iteration = 12 status = {}
32132025-06-30T23:47:51.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa2491d4-688b-4e18-8c09-765110d4a25a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32142025-06-30T23:47:51.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa2491d4-688b-4e18-8c09-765110d4a25a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32152025-06-30T23:47:51.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa2491d4-688b-4e18-8c09-765110d4a25a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32162025-06-30T23:47:52.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 936a498f-bb65-40dd-96ca-cf7598e50168 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32172025-06-30T23:47:52.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 936a498f-bb65-40dd-96ca-cf7598e50168 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32182025-06-30T23:47:52.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 936a498f-bb65-40dd-96ca-cf7598e50168 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32192025-06-30T23:47:53.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fc8e9e-303e-4222-a6d1-fb4ecdc25ddb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32202025-06-30T23:47:53.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fc8e9e-303e-4222-a6d1-fb4ecdc25ddb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32212025-06-30T23:47:53.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f7fc8e9e-303e-4222-a6d1-fb4ecdc25ddb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32222025-06-30T23:47:54.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = f33d6189-ada1-49b8-860c-2bec9cedf0f3 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
32232025-06-30T23:47:54.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 182a3ce8-e7d7-4eba-b1eb-0bc647cdaf11 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32242025-06-30T23:47:54.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 182a3ce8-e7d7-4eba-b1eb-0bc647cdaf11 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32252025-06-30T23:47:54.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 182a3ce8-e7d7-4eba-b1eb-0bc647cdaf11 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32262025-06-30T23:47:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39001351-edb4-4fc9-bce9-315807cb7e82 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32272025-06-30T23:47:55.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39001351-edb4-4fc9-bce9-315807cb7e82 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32282025-06-30T23:47:55.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39001351-edb4-4fc9-bce9-315807cb7e82 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32292025-06-30T23:47:56.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be745bb9-1a5e-4ce6-8de4-af4cd5d010ee roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32302025-06-30T23:47:56.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be745bb9-1a5e-4ce6-8de4-af4cd5d010ee resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32312025-06-30T23:47:56.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be745bb9-1a5e-4ce6-8de4-af4cd5d010ee response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32322025-06-30T23:47:57.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8f365bb-738d-40ec-b870-4fe911139947 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32332025-06-30T23:47:57.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8f365bb-738d-40ec-b870-4fe911139947 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32342025-06-30T23:47:57.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c8f365bb-738d-40ec-b870-4fe911139947 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32352025-06-30T23:47:58.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ba58204c-d685-441c-9231-f528fafc63ff roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32362025-06-30T23:47:58.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ba58204c-d685-441c-9231-f528fafc63ff resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32372025-06-30T23:47:58.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ba58204c-d685-441c-9231-f528fafc63ff response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32382025-06-30T23:47:59.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dc94f191-0c04-462f-8d10-907e33a2bf84 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32392025-06-30T23:47:59.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dc94f191-0c04-462f-8d10-907e33a2bf84 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32402025-06-30T23:47:59.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dc94f191-0c04-462f-8d10-907e33a2bf84 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32412025-06-30T23:48:00.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 565e361e-3594-4dd5-b11e-584c34dbae4f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32422025-06-30T23:48:00.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 565e361e-3594-4dd5-b11e-584c34dbae4f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32432025-06-30T23:48:00.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 565e361e-3594-4dd5-b11e-584c34dbae4f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32442025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
32452025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32462025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
32472025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32482025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32492025-06-30T23:48:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32502025-06-30T23:48:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32512025-06-30T23:48:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32522025-06-30T23:48:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32532025-06-30T23:48:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32542025-06-30T23:48:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32552025-06-30T23:48:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32562025-06-30T23:48:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32572025-06-30T23:48:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
32582025-06-30T23:48:01.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32592025-06-30T23:48:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32602025-06-30T23:48:01.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
32612025-06-30T23:48:01.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.315965ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
32622025-06-30T23:48:01.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32632025-06-30T23:48:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32642025-06-30T23:48:01.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.72879ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32652025-06-30T23:48:01.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5de2bb16-1775-46b2-98cf-8ee80f5fc366 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32662025-06-30T23:48:01.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5de2bb16-1775-46b2-98cf-8ee80f5fc366 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32672025-06-30T23:48:01.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5de2bb16-1775-46b2-98cf-8ee80f5fc366 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32682025-06-30T23:48:02.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b7330a3-bcf0-4abb-84d6-c5b4d6adf0c8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32692025-06-30T23:48:02.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b7330a3-bcf0-4abb-84d6-c5b4d6adf0c8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32702025-06-30T23:48:02.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2b7330a3-bcf0-4abb-84d6-c5b4d6adf0c8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32712025-06-30T23:48:03.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3b7a537c-9065-4c12-9d9c-ed3a9af4fa3d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32722025-06-30T23:48:03.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3b7a537c-9065-4c12-9d9c-ed3a9af4fa3d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32732025-06-30T23:48:03.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3b7a537c-9065-4c12-9d9c-ed3a9af4fa3d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32742025-06-30T23:48:04.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 16fee567-ed89-49a6-b264-847f45b014cb roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
32752025-06-30T23:48:04.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 16fee567-ed89-49a6-b264-847f45b014cb resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
32762025-06-30T23:48:04.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 16fee567-ed89-49a6-b264-847f45b014cb response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
32772025-06-30T23:48:04.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 458ff712-412b-4a97-ada2-f4d9a535c2c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
32782025-06-30T23:48:04.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 458ff712-412b-4a97-ada2-f4d9a535c2c8 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
32792025-06-30T23:48:04.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42504 req_id = 458ff712-412b-4a97-ada2-f4d9a535c2c8 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
32802025-06-30T23:48:04.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 852 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = c6835e39-1938-4db1-9cfc-efd7cd0b4d9a response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
32812025-06-30T23:48:04.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d752d22c-8923-4e78-a662-6308465e922a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32822025-06-30T23:48:04.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d752d22c-8923-4e78-a662-6308465e922a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32832025-06-30T23:48:04.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d752d22c-8923-4e78-a662-6308465e922a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32842025-06-30T23:48:05.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be115a35-3425-4458-b091-66a9f69622fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32852025-06-30T23:48:05.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be115a35-3425-4458-b091-66a9f69622fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32862025-06-30T23:48:05.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = be115a35-3425-4458-b091-66a9f69622fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32872025-06-30T23:48:06.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa461bd8-4b5a-43fa-b095-a1448da43e36 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32882025-06-30T23:48:06.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa461bd8-4b5a-43fa-b095-a1448da43e36 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32892025-06-30T23:48:06.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aa461bd8-4b5a-43fa-b095-a1448da43e36 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32902025-06-30T23:48:07.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca2c9885-21fb-4c32-afa8-e762e5673f4f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32912025-06-30T23:48:07.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca2c9885-21fb-4c32-afa8-e762e5673f4f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32922025-06-30T23:48:07.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca2c9885-21fb-4c32-afa8-e762e5673f4f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32932025-06-30T23:48:08.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bcbfb57b-307a-4ac1-a059-da88bafd5840 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32942025-06-30T23:48:08.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bcbfb57b-307a-4ac1-a059-da88bafd5840 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32952025-06-30T23:48:08.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bcbfb57b-307a-4ac1-a059-da88bafd5840 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32962025-06-30T23:48:09.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c2e66947-4a5e-4f8e-b788-44f7755fc462 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32972025-06-30T23:48:09.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c2e66947-4a5e-4f8e-b788-44f7755fc462 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32982025-06-30T23:48:09.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c2e66947-4a5e-4f8e-b788-44f7755fc462 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
32992025-06-30T23:48:10.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a2837fe5-f96d-46de-bd04-fe29238e015f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33002025-06-30T23:48:10.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a2837fe5-f96d-46de-bd04-fe29238e015f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33012025-06-30T23:48:11.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a2837fe5-f96d-46de-bd04-fe29238e015f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33022025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
33032025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
33042025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33052025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33062025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33072025-06-30T23:48:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33082025-06-30T23:48:11.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33092025-06-30T23:48:11.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33102025-06-30T23:48:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112025-06-30T23:48:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.675805ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33122025-06-30T23:48:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33132025-06-30T23:48:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33142025-06-30T23:48:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33152025-06-30T23:48:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33162025-06-30T23:48:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33172025-06-30T23:48:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182025-06-30T23:48:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
33192025-06-30T23:48:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33202025-06-30T23:48:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33212025-06-30T23:48:11.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
33222025-06-30T23:48:11.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.357858ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
33232025-06-30T23:48:12.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bfa24fd9-bd49-4f31-a346-0bc1391a1c4b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33242025-06-30T23:48:12.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bfa24fd9-bd49-4f31-a346-0bc1391a1c4b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33252025-06-30T23:48:12.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bfa24fd9-bd49-4f31-a346-0bc1391a1c4b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33262025-06-30T23:48:13.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaf09a26-f828-4ef6-b081-9e50f640a5e2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33272025-06-30T23:48:13.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaf09a26-f828-4ef6-b081-9e50f640a5e2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33282025-06-30T23:48:13.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eaf09a26-f828-4ef6-b081-9e50f640a5e2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33292025-06-30T23:48:14.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d6d8f74-1ef8-4f32-8a6f-920483cd84cd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33302025-06-30T23:48:14.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d6d8f74-1ef8-4f32-8a6f-920483cd84cd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33312025-06-30T23:48:14.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d6d8f74-1ef8-4f32-8a6f-920483cd84cd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33322025-06-30T23:48:14.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 0f646c9a-0391-4ac4-9dd8-e26134e595c1 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
33332025-06-30T23:48:15.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6c293637-bdae-4d93-9fdf-90ab0421c260 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33342025-06-30T23:48:15.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6c293637-bdae-4d93-9fdf-90ab0421c260 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33352025-06-30T23:48:15.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6c293637-bdae-4d93-9fdf-90ab0421c260 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33362025-06-30T23:48:16.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac3c3402-cc1c-4699-975a-bd2ccfea89cf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33372025-06-30T23:48:16.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac3c3402-cc1c-4699-975a-bd2ccfea89cf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33382025-06-30T23:48:16.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac3c3402-cc1c-4699-975a-bd2ccfea89cf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33392025-06-30T23:48:17.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5aad7d8d-4893-4be4-a18d-1b249021afeb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33402025-06-30T23:48:17.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5aad7d8d-4893-4be4-a18d-1b249021afeb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33412025-06-30T23:48:17.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5aad7d8d-4893-4be4-a18d-1b249021afeb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33422025-06-30T23:48:18.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d73ed053-d772-4f09-87d3-8873ef39c7fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33432025-06-30T23:48:18.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d73ed053-d772-4f09-87d3-8873ef39c7fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33442025-06-30T23:48:18.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d73ed053-d772-4f09-87d3-8873ef39c7fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33452025-06-30T23:48:19.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 116b5f5e-f9b1-4533-b8a8-7cdce179c67d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33462025-06-30T23:48:19.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 116b5f5e-f9b1-4533-b8a8-7cdce179c67d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33472025-06-30T23:48:19.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 116b5f5e-f9b1-4533-b8a8-7cdce179c67d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33482025-06-30T23:48:20.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 26f973c8-9f92-4960-9286-018d3e56f939 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33492025-06-30T23:48:20.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 26f973c8-9f92-4960-9286-018d3e56f939 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33502025-06-30T23:48:20.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 26f973c8-9f92-4960-9286-018d3e56f939 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
33512025-06-30T23:48:21.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
33522025-06-30T23:48:21.027ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
33532025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
33542025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 30.85\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
33552025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33562025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
33572025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33582025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
33592025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33602025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
33612025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
33622025-06-30T23:48:21.027ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:38:21.027003386 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33632025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
33642025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33652025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33662025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
33672025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
33682025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33692025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33702025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
33712025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
33722025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33732025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
33742025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33752025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33762025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33772025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33782025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33792025-06-30T23:48:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33802025-06-30T23:48:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 663071731 } })
33812025-06-30T23:48:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 663093651 } })
33822025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33832025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.111986ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33842025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33852025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.195648ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33862025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33872025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
33882025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
33892025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
33902025-06-30T23:48:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
33912025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33922025-06-30T23:48:21.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33932025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33942025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 10 reason = Timeout
33952025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
33962025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.34\u{b5}s iteration = 10 status = "Disabled"
33972025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
33982025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
33992025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34002025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
34012025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34022025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34032025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
34042025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
34052025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34062025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34072025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
34082025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34092025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
34102025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34112025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34122025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34132025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34142025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34152025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34162025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34172025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34182025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34192025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34202025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34212025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34222025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34232025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34252025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34262025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34272025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34282025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34292025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34302025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34312025-06-30T23:48:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34322025-06-30T23:48:21.030ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:38:21.027003386 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34332025-06-30T23:48:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.149953ms iteration = 7 status = {"expiration":"2025-06-30T23:38:21.027003386Z","pruned":[]}
34342025-06-30T23:48:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.491891ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34352025-06-30T23:48:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362025-06-30T23:48:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 667424701 } })
34372025-06-30T23:48:21.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
34382025-06-30T23:48:21.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34392025-06-30T23:48:21.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34402025-06-30T23:48:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 668334683 } })
34412025-06-30T23:48:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34422025-06-30T23:48:21.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34432025-06-30T23:48:21.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
34442025-06-30T23:48:21.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34452025-06-30T23:48:21.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462025-06-30T23:48:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34472025-06-30T23:48:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34482025-06-30T23:48:21.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 7 reason = Timeout
34512025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
34522025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
34532025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34542025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 7 reason = Timeout
34552025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
34562025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
34572025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34582025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
34592025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34602025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
34612025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34622025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
34632025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34642025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34652025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
34662025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
34672025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34682025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
34692025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34702025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
34712025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34722025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34732025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
34742025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34752025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
34762025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34772025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
34782025-06-30T23:48:21.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34792025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34802025-06-30T23:48:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
34812025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34822025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34832025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34852025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
34862025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34872025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34882025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
34892025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34902025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34912025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34922025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34932025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34942025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34952025-06-30T23:48:21.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962025-06-30T23:48:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34972025-06-30T23:48:21.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34982025-06-30T23:48:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34992025-06-30T23:48:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35002025-06-30T23:48:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 13 reason = Timeout
35012025-06-30T23:48:21.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 674583027 } })
35022025-06-30T23:48:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35032025-06-30T23:48:21.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35042025-06-30T23:48:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35052025-06-30T23:48:21.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35062025-06-30T23:48:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35072025-06-30T23:48:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35082025-06-30T23:48:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35092025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35102025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35112025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35122025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35132025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35142025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35152025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35162025-06-30T23:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35172025-06-30T23:48:21.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35192025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35202025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35212025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35222025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35232025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35242025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.777232ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35252025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35262025-06-30T23:48:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35272025-06-30T23:48:21.047ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
35282025-06-30T23:48:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 11.046826ms iteration = 7 status = {"by_rx":{},"error":null}
35292025-06-30T23:48:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35302025-06-30T23:48:21.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35312025-06-30T23:48:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35322025-06-30T23:48:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.10903ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
35332025-06-30T23:48:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.55455ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
35342025-06-30T23:48:21.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35352025-06-30T23:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35362025-06-30T23:48:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.657179ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
35372025-06-30T23:48:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35382025-06-30T23:48:21.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392025-06-30T23:48:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35402025-06-30T23:48:21.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35412025-06-30T23:48:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35422025-06-30T23:48:21.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35432025-06-30T23:48:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35442025-06-30T23:48:21.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35452025-06-30T23:48:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35462025-06-30T23:48:21.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35472025-06-30T23:48:21.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482025-06-30T23:48:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35492025-06-30T23:48:21.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35502025-06-30T23:48:21.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35512025-06-30T23:48:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35522025-06-30T23:48:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35532025-06-30T23:48:21.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35542025-06-30T23:48:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35552025-06-30T23:48:21.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35562025-06-30T23:48:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35572025-06-30T23:48:21.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35582025-06-30T23:48:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35592025-06-30T23:48:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 28.247894ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35602025-06-30T23:48:21.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35612025-06-30T23:48:21.065ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
35622025-06-30T23:48:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
35632025-06-30T23:48:21.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35652025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35662025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35672025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35682025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
35692025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35702025-06-30T23:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35712025-06-30T23:48:21.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35722025-06-30T23:48:21.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35732025-06-30T23:48:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35742025-06-30T23:48:21.078ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 41.50566ms iteration = 7 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
35752025-06-30T23:48:21.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35762025-06-30T23:48:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35772025-06-30T23:48:21.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35782025-06-30T23:48:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35792025-06-30T23:48:21.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35802025-06-30T23:48:21.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35812025-06-30T23:48:21.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35822025-06-30T23:48:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35832025-06-30T23:48:21.095ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
35842025-06-30T23:48:21.095ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35852025-06-30T23:48:21.095ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
35862025-06-30T23:48:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 68.29361ms iteration = 7 status = {"generation":2}
35872025-06-30T23:48:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35882025-06-30T23:48:21.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35892025-06-30T23:48:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35902025-06-30T23:48:21.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35912025-06-30T23:48:21.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35922025-06-30T23:48:21.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35932025-06-30T23:48:21.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942025-06-30T23:48:21.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35952025-06-30T23:48:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35962025-06-30T23:48:21.101ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 736498250 } })
35972025-06-30T23:48:21.101ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
35982025-06-30T23:48:21.102ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992025-06-30T23:48:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36002025-06-30T23:48:21.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012025-06-30T23:48:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36022025-06-30T23:48:21.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36032025-06-30T23:48:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36042025-06-30T23:48:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36052025-06-30T23:48:21.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36062025-06-30T23:48:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36072025-06-30T23:48:21.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082025-06-30T23:48:21.107ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-06-30T23:48:21.109ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36102025-06-30T23:48:21.109ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36112025-06-30T23:48:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.223914ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36122025-06-30T23:48:21.110ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36132025-06-30T23:48:21.110ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36142025-06-30T23:48:21.110ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36152025-06-30T23:48:21.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36162025-06-30T23:48:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36172025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36182025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36192025-06-30T23:48:21.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36202025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36212025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36222025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
36232025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36242025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36252025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36272025-06-30T23:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36282025-06-30T23:48:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 84.378842ms iteration = 4 status = {"nsuccess":5}
36292025-06-30T23:48:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 77.252697ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
36302025-06-30T23:48:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36312025-06-30T23:48:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36322025-06-30T23:48:21.115ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36332025-06-30T23:48:21.115ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36342025-06-30T23:48:21.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36352025-06-30T23:48:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36362025-06-30T23:48:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36372025-06-30T23:48:21.116ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36382025-06-30T23:48:21.116ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
36392025-06-30T23:48:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.644468ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36402025-06-30T23:48:21.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36412025-06-30T23:48:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36422025-06-30T23:48:21.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36432025-06-30T23:48:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36442025-06-30T23:48:21.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36452025-06-30T23:48:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36462025-06-30T23:48:21.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.601884ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36472025-06-30T23:48:21.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36482025-06-30T23:48:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36492025-06-30T23:48:21.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502025-06-30T23:48:21.124ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
36512025-06-30T23:48:21.124ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 87.7563ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36522025-06-30T23:48:21.125ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36532025-06-30T23:48:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.656481ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36542025-06-30T23:48:21.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36552025-06-30T23:48:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36562025-06-30T23:48:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
36572025-06-30T23:48:21.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36582025-06-30T23:48:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36592025-06-30T23:48:21.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
36602025-06-30T23:48:21.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.720391ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
36612025-06-30T23:48:21.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622025-06-30T23:48:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.762704ms iteration = 13 status = 0
36632025-06-30T23:48:21.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36642025-06-30T23:48:21.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36652025-06-30T23:48:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36662025-06-30T23:48:21.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.581139ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36672025-06-30T23:48:21.142ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.182678ms iteration = 15 status = {"physical_disks_added":0}
36682025-06-30T23:48:21.142ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
36692025-06-30T23:48:21.142ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.521836ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36702025-06-30T23:48:21.150ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36712025-06-30T23:48:21.150ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36722025-06-30T23:48:21.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36732025-06-30T23:48:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36742025-06-30T23:48:21.150ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36752025-06-30T23:48:21.150ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36762025-06-30T23:48:21.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.696941ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36772025-06-30T23:48:21.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782025-06-30T23:48:21.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36792025-06-30T23:48:21.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36802025-06-30T23:48:21.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36812025-06-30T23:48:21.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5f91536-f480-440b-be89-78d2bdaa883e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
36822025-06-30T23:48:21.157ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
36832025-06-30T23:48:21.157ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36842025-06-30T23:48:21.157ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
36852025-06-30T23:48:21.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 130.129901ms iteration = 7 status = {"generation":1}
36862025-06-30T23:48:21.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5f91536-f480-440b-be89-78d2bdaa883e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
36872025-06-30T23:48:21.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5f91536-f480-440b-be89-78d2bdaa883e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
36882025-06-30T23:48:21.182ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
36892025-06-30T23:48:21.182ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 155.847815ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36902025-06-30T23:48:21.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36912025-06-30T23:48:21.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36922025-06-30T23:48:21.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36932025-06-30T23:48:21.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36942025-06-30T23:48:21.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36952025-06-30T23:48:21.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36962025-06-30T23:48:21.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972025-06-30T23:48:21.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36982025-06-30T23:48:21.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36992025-06-30T23:48:21.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37002025-06-30T23:48:21.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37012025-06-30T23:48:21.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
37022025-06-30T23:48:21.230ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37032025-06-30T23:48:21.230ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f73d1d6-1114-4b0b-ba41-2e6375d29c9d", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37042025-06-30T23:48:21.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37052025-06-30T23:48:21.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37062025-06-30T23:48:21.240ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
37072025-06-30T23:48:21.240ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf5e66d0-8736-4176-8bec-ce55e25c69ae", "content-length": "78", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37082025-06-30T23:48:21.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
37092025-06-30T23:48:21.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
37102025-06-30T23:48:21.240ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
37112025-06-30T23:48:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
37122025-06-30T23:48:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
37132025-06-30T23:48:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
37142025-06-30T23:48:21.242ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
37152025-06-30T23:48:21.242ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
37162025-06-30T23:48:21.243ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
37172025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
37182025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
37192025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
37202025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
37212025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
37222025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
37232025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
37242025-06-30T23:48:21.245ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
37252025-06-30T23:48:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
37262025-06-30T23:48:21.246ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
37272025-06-30T23:48:21.246ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
37282025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "073441c1-bddc-40a5-a47b-5c212ce5a7a0", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37292025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
37302025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
37312025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
37322025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
37332025-06-30T23:48:21.247ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cbece1e-57fd-4790-9f8c-a57fb365dcb4", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37342025-06-30T23:48:21.248ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "71795cd0-b9a7-4332-bd51-7c04cbb5fa76", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37352025-06-30T23:48:21.250ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 211.225536ms iteration = 13 status = {"errors":[],"sps":[]}
37362025-06-30T23:48:21.272ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
37372025-06-30T23:48:21.272ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37382025-06-30T23:48:21.272ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b447cbcd-8582-410b-ad66-daba43593d9d", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37392025-06-30T23:48:21.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37402025-06-30T23:48:21.273ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
37412025-06-30T23:48:21.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37422025-06-30T23:48:21.379ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37432025-06-30T23:48:21.379ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37442025-06-30T23:48:21.379ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "268f4e08-4304-48c5-9f73-1ae48cea2c78", "content-length": "372", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37452025-06-30T23:48:21.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37462025-06-30T23:48:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37472025-06-30T23:48:21.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
37482025-06-30T23:48:21.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37492025-06-30T23:48:21.393ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "055e26d8-3155-462d-9e59-ec3fdd8eb1d5", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37502025-06-30T23:48:21.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37512025-06-30T23:48:21.393ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37522025-06-30T23:48:21.393ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37532025-06-30T23:48:21.394ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b44cb5b1-e5a6-495f-9e81-5f74a70be4a4", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37542025-06-30T23:48:21.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37552025-06-30T23:48:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37562025-06-30T23:48:21.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37572025-06-30T23:48:21.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582025-06-30T23:48:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37592025-06-30T23:48:21.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37602025-06-30T23:48:21.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37612025-06-30T23:48:21.402ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37622025-06-30T23:48:21.402ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37632025-06-30T23:48:21.403ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56c41375-37a4-4bc1-8ded-dc374a28fb15", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37642025-06-30T23:48:21.404ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 367.753567ms iteration = 13 status = {}
37652025-06-30T23:48:21.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37662025-06-30T23:48:21.413ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8432c6a-b371-4bae-8edb-75044de7d693", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37672025-06-30T23:48:21.413ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37682025-06-30T23:48:21.415ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "88b8ef21-91f2-463c-b305-88d1f4584a9f", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37692025-06-30T23:48:21.415ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37702025-06-30T23:48:21.417ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
37712025-06-30T23:48:21.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 390.092573ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37722025-06-30T23:48:21.506ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37732025-06-30T23:48:21.549ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37742025-06-30T23:48:21.550ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b30c8da7-ccbe-4886-8646-f618fbc1ab0c", "content-length": "691", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
37752025-06-30T23:48:21.550ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37762025-06-30T23:48:21.550ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37772025-06-30T23:48:21.550ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37782025-06-30T23:48:21.552ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 523.175123ms iteration = 13 status = {}
37792025-06-30T23:48:21.564ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 537.021783ms iteration = 13 status = {}
37802025-06-30T23:48:21.598ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37812025-06-30T23:48:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37822025-06-30T23:48:21.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37832025-06-30T23:48:21.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3ceb2262-2bc0-4433-8de4-f18670154368", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37842025-06-30T23:48:21.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37852025-06-30T23:48:21.600ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 573.527337ms iteration = 13 status = null
37862025-06-30T23:48:21.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7b59b116-e455-4be3-9db6-5daf4f358e6c", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37872025-06-30T23:48:21.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37882025-06-30T23:48:21.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "45dfcb58-e196-4845-89a0-d2a828fb1141", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37892025-06-30T23:48:21.602ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37902025-06-30T23:48:21.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
37912025-06-30T23:48:21.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 577.51478ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37922025-06-30T23:48:21.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37932025-06-30T23:48:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37942025-06-30T23:48:21.618ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
37952025-06-30T23:48:21.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37962025-06-30T23:48:21.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37972025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
37982025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
37992025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38002025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38012025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38022025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38032025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38042025-06-30T23:48:21.628ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38052025-06-30T23:48:21.629ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38062025-06-30T23:48:21.629ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38072025-06-30T23:48:21.629ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
38082025-06-30T23:48:21.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38092025-06-30T23:48:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38102025-06-30T23:48:21.631ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
38112025-06-30T23:48:21.631ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38122025-06-30T23:48:21.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79282339-7f85-489c-8280-6fc759ffdd53", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
38132025-06-30T23:48:21.735ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
38142025-06-30T23:48:21.735ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38152025-06-30T23:48:21.736ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c33ab6c7-b4c8-43cb-abd3-17b55bfdaf6f", "content-length": "682", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
38162025-06-30T23:48:21.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38172025-06-30T23:48:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38182025-06-30T23:48:21.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38192025-06-30T23:48:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38202025-06-30T23:48:21.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38212025-06-30T23:48:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38222025-06-30T23:48:21.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232025-06-30T23:48:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38242025-06-30T23:48:21.754ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 725.33716ms iteration = 13 status = {}
38252025-06-30T23:48:21.782ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 2
38262025-06-30T23:48:21.782ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
38272025-06-30T23:48:21.813ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
38282025-06-30T23:48:21.813ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38877
38292025-06-30T23:48:21.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38877 req_id = 3add8e32-44ff-4018-a2c0-ac8b7dc094d0 roles = RoleSet { roles: {} } uri = /metrics/producers
38302025-06-30T23:48:21.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38877 req_id = 3add8e32-44ff-4018-a2c0-ac8b7dc094d0 resource = Database result = Ok(()) uri = /metrics/producers
38312025-06-30T23:48:21.887ZINFOnexus: assigned collector to new producer collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 file = nexus/src/app/oximeter.rs:76 producer_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
38322025-06-30T23:48:21.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 74138 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38877 req_id = 3add8e32-44ff-4018-a2c0-ac8b7dc094d0 response_code = 201 uri = /metrics/producers
38332025-06-30T23:48:21.887ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3add8e32-44ff-4018-a2c0-ac8b7dc094d0", "content-length": "41", "date": "Mon, 30 Jun 2025 23:48:21 GMT"} })
38342025-06-30T23:48:21.903ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
38352025-06-30T23:48:22.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac518b18-3039-4552-bf36-965a84a544f9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38362025-06-30T23:48:22.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac518b18-3039-4552-bf36-965a84a544f9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38372025-06-30T23:48:22.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac518b18-3039-4552-bf36-965a84a544f9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38382025-06-30T23:48:23.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d776cc7e-abdc-471b-9428-1230ba80bde4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38392025-06-30T23:48:23.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d776cc7e-abdc-471b-9428-1230ba80bde4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38402025-06-30T23:48:23.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d776cc7e-abdc-471b-9428-1230ba80bde4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38412025-06-30T23:48:24.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1821e1e4-f756-4fbf-819a-bc4cd6d5bb15 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38422025-06-30T23:48:24.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1821e1e4-f756-4fbf-819a-bc4cd6d5bb15 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38432025-06-30T23:48:24.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1821e1e4-f756-4fbf-819a-bc4cd6d5bb15 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38442025-06-30T23:48:24.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 9f05297c-75a1-4ba1-afbf-0cd1d7d2dcac response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
38452025-06-30T23:48:25.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a998b5c-b4b1-4dc1-8dbe-3c4184bd491f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38462025-06-30T23:48:25.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a998b5c-b4b1-4dc1-8dbe-3c4184bd491f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38472025-06-30T23:48:25.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a998b5c-b4b1-4dc1-8dbe-3c4184bd491f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38482025-06-30T23:48:26.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b31e790b-1a80-49f7-9f0b-40ea738af8e3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38492025-06-30T23:48:26.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b31e790b-1a80-49f7-9f0b-40ea738af8e3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38502025-06-30T23:48:26.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b31e790b-1a80-49f7-9f0b-40ea738af8e3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38512025-06-30T23:48:27.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 806e7045-21ad-470b-a8d0-4e9ce876271d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38522025-06-30T23:48:27.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 806e7045-21ad-470b-a8d0-4e9ce876271d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38532025-06-30T23:48:27.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 806e7045-21ad-470b-a8d0-4e9ce876271d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38542025-06-30T23:48:28.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 206d843c-5e33-4ea7-9b3c-54ff58cd45d1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38552025-06-30T23:48:28.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 206d843c-5e33-4ea7-9b3c-54ff58cd45d1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38562025-06-30T23:48:28.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 206d843c-5e33-4ea7-9b3c-54ff58cd45d1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38572025-06-30T23:48:29.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29cd3486-4ade-4544-9fc4-cf913a8967bf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38582025-06-30T23:48:29.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29cd3486-4ade-4544-9fc4-cf913a8967bf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38592025-06-30T23:48:29.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29cd3486-4ade-4544-9fc4-cf913a8967bf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38602025-06-30T23:48:30.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb09e4a9-72e6-42a4-9b03-aef67ab795f4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38612025-06-30T23:48:30.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb09e4a9-72e6-42a4-9b03-aef67ab795f4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38622025-06-30T23:48:30.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb09e4a9-72e6-42a4-9b03-aef67ab795f4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38632025-06-30T23:48:31.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
38642025-06-30T23:48:31.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38652025-06-30T23:48:31.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
38662025-06-30T23:48:31.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672025-06-30T23:48:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38682025-06-30T23:48:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38692025-06-30T23:48:31.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38702025-06-30T23:48:31.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38712025-06-30T23:48:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722025-06-30T23:48:31.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.664365ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38732025-06-30T23:48:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38742025-06-30T23:48:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38752025-06-30T23:48:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38762025-06-30T23:48:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38772025-06-30T23:48:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38782025-06-30T23:48:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792025-06-30T23:48:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
38802025-06-30T23:48:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38812025-06-30T23:48:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38822025-06-30T23:48:31.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
38832025-06-30T23:48:31.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.423716ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
38842025-06-30T23:48:31.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 14fea7a3-ca1a-4259-bb18-b826189def5a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38852025-06-30T23:48:31.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 14fea7a3-ca1a-4259-bb18-b826189def5a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38862025-06-30T23:48:31.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 14fea7a3-ca1a-4259-bb18-b826189def5a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38872025-06-30T23:48:32.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 227c4276-1306-488f-8a50-30fd5c913d45 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38882025-06-30T23:48:32.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 227c4276-1306-488f-8a50-30fd5c913d45 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38892025-06-30T23:48:32.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 227c4276-1306-488f-8a50-30fd5c913d45 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38902025-06-30T23:48:33.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6a0dbc3-029e-4905-89e0-3ab388c20f98 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38912025-06-30T23:48:33.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6a0dbc3-029e-4905-89e0-3ab388c20f98 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38922025-06-30T23:48:33.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d6a0dbc3-029e-4905-89e0-3ab388c20f98 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38932025-06-30T23:48:34.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 1dd3112e-f6a7-4e6d-96c0-a3d3f70de976 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
38942025-06-30T23:48:34.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 345a5afc-649c-4434-aa6d-278192ec4ef4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38952025-06-30T23:48:34.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 345a5afc-649c-4434-aa6d-278192ec4ef4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38962025-06-30T23:48:34.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 345a5afc-649c-4434-aa6d-278192ec4ef4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38972025-06-30T23:48:35.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08aeb51b-6170-485a-b3a7-0ca59dc8929f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38982025-06-30T23:48:35.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08aeb51b-6170-485a-b3a7-0ca59dc8929f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
38992025-06-30T23:48:35.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08aeb51b-6170-485a-b3a7-0ca59dc8929f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39002025-06-30T23:48:36.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = feaa2280-6060-4a30-a2ca-83e61117d673 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39012025-06-30T23:48:36.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = feaa2280-6060-4a30-a2ca-83e61117d673 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39022025-06-30T23:48:36.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = feaa2280-6060-4a30-a2ca-83e61117d673 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39032025-06-30T23:48:37.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e2db1fa0-8360-4261-b474-996171778f1c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39042025-06-30T23:48:37.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e2db1fa0-8360-4261-b474-996171778f1c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39052025-06-30T23:48:37.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e2db1fa0-8360-4261-b474-996171778f1c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39062025-06-30T23:48:38.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 717c675e-8506-4f67-ad13-eaff5800b4bb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39072025-06-30T23:48:38.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 717c675e-8506-4f67-ad13-eaff5800b4bb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39082025-06-30T23:48:38.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 717c675e-8506-4f67-ad13-eaff5800b4bb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39092025-06-30T23:48:39.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 343105b2-44e0-446d-8526-0d6fcda6c3d8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39102025-06-30T23:48:39.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 343105b2-44e0-446d-8526-0d6fcda6c3d8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39112025-06-30T23:48:39.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 343105b2-44e0-446d-8526-0d6fcda6c3d8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39122025-06-30T23:48:40.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8f980637-baa8-4a92-af30-a4c561891120 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39132025-06-30T23:48:40.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8f980637-baa8-4a92-af30-a4c561891120 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39142025-06-30T23:48:40.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8f980637-baa8-4a92-af30-a4c561891120 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39152025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
39162025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
39172025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39182025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39192025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39202025-06-30T23:48:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39212025-06-30T23:48:41.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39222025-06-30T23:48:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232025-06-30T23:48:41.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39242025-06-30T23:48:41.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.728056ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39252025-06-30T23:48:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39262025-06-30T23:48:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39272025-06-30T23:48:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282025-06-30T23:48:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292025-06-30T23:48:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39302025-06-30T23:48:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312025-06-30T23:48:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
39322025-06-30T23:48:41.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39332025-06-30T23:48:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39342025-06-30T23:48:41.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
39352025-06-30T23:48:41.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.720505ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
39362025-06-30T23:48:41.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 301bbab6-a76c-4ab5-9276-f90ba3280aab roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39372025-06-30T23:48:41.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 301bbab6-a76c-4ab5-9276-f90ba3280aab resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39382025-06-30T23:48:41.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 301bbab6-a76c-4ab5-9276-f90ba3280aab response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39392025-06-30T23:48:42.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 971244ff-0b40-498e-be19-d82701b47663 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39402025-06-30T23:48:42.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 971244ff-0b40-498e-be19-d82701b47663 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39412025-06-30T23:48:42.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 971244ff-0b40-498e-be19-d82701b47663 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39422025-06-30T23:48:43.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a61912da-725d-47f0-a800-5b85f5372fc3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39432025-06-30T23:48:43.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a61912da-725d-47f0-a800-5b85f5372fc3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39442025-06-30T23:48:43.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a61912da-725d-47f0-a800-5b85f5372fc3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39452025-06-30T23:48:44.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = a8b72b87-0b66-4529-b710-00195dc2ab66 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
39462025-06-30T23:48:44.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 677075fb-1189-4fb9-8260-4fd9047371c5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39472025-06-30T23:48:44.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 677075fb-1189-4fb9-8260-4fd9047371c5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39482025-06-30T23:48:44.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 677075fb-1189-4fb9-8260-4fd9047371c5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39492025-06-30T23:48:45.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2fdc0590-8c3c-4911-adda-0b6c2fbe3048 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39502025-06-30T23:48:45.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2fdc0590-8c3c-4911-adda-0b6c2fbe3048 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39512025-06-30T23:48:45.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2fdc0590-8c3c-4911-adda-0b6c2fbe3048 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39522025-06-30T23:48:46.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f666333c-be39-4cba-84b8-eee0a44e3c6b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39532025-06-30T23:48:46.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f666333c-be39-4cba-84b8-eee0a44e3c6b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39542025-06-30T23:48:46.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f666333c-be39-4cba-84b8-eee0a44e3c6b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39552025-06-30T23:48:47.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cce9ffcb-8a39-4e35-9d19-a8bdaa607b4c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39562025-06-30T23:48:47.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cce9ffcb-8a39-4e35-9d19-a8bdaa607b4c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39572025-06-30T23:48:47.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cce9ffcb-8a39-4e35-9d19-a8bdaa607b4c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39582025-06-30T23:48:48.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aeabffcb-abdd-4814-82c8-798bbe576d35 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39592025-06-30T23:48:48.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aeabffcb-abdd-4814-82c8-798bbe576d35 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39602025-06-30T23:48:48.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aeabffcb-abdd-4814-82c8-798bbe576d35 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39612025-06-30T23:48:49.321ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:33491
39622025-06-30T23:48:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 0a5ff8e2-3da9-4c26-bd7c-bbc03a992e23 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
39632025-06-30T23:48:49.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 0a5ff8e2-3da9-4c26-bd7c-bbc03a992e23 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
39642025-06-30T23:48:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 0a5ff8e2-3da9-4c26-bd7c-bbc03a992e23 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
39652025-06-30T23:48:49.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = cfc9468a-4b63-4446-81d7-903571465d7e roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
39662025-06-30T23:48:49.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = cfc9468a-4b63-4446-81d7-903571465d7e resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
39672025-06-30T23:48:49.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = cfc9468a-4b63-4446-81d7-903571465d7e response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
39682025-06-30T23:48:49.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d22e3d0-0efd-43c8-b164-250403ae91ff roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39692025-06-30T23:48:49.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d22e3d0-0efd-43c8-b164-250403ae91ff resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39702025-06-30T23:48:49.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2d22e3d0-0efd-43c8-b164-250403ae91ff response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39712025-06-30T23:48:50.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a44b701-0aca-4cd5-bdcc-e3423cb71f8a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39722025-06-30T23:48:50.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a44b701-0aca-4cd5-bdcc-e3423cb71f8a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39732025-06-30T23:48:50.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a44b701-0aca-4cd5-bdcc-e3423cb71f8a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
39742025-06-30T23:48:51.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
39752025-06-30T23:48:51.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
39762025-06-30T23:48:51.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
39772025-06-30T23:48:51.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39782025-06-30T23:48:51.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39792025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39802025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39812025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
39822025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
39832025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39842025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39852025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
39862025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39872025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
39882025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39892025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
39902025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
39912025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39922025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39932025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
39942025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39952025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
39962025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39972025-06-30T23:48:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39982025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39992025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40002025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40012025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40022025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40032025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40042025-06-30T23:48:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40052025-06-30T23:48:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 666642883 } })
40062025-06-30T23:48:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
40072025-06-30T23:48:51.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082025-06-30T23:48:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 667129434 } })
40092025-06-30T23:48:51.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
40102025-06-30T23:48:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.679508ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40112025-06-30T23:48:51.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122025-06-30T23:48:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40132025-06-30T23:48:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40142025-06-30T23:48:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152025-06-30T23:48:51.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162025-06-30T23:48:51.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172025-06-30T23:48:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.284735ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40182025-06-30T23:48:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40192025-06-30T23:48:51.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40202025-06-30T23:48:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40212025-06-30T23:48:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40222025-06-30T23:48:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40232025-06-30T23:48:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40242025-06-30T23:48:51.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40252025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40262025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
40272025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40282025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
40292025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40302025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
40312025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40322025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40332025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
40342025-06-30T23:48:51.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40352025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40362025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
40372025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40382025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
40392025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40402025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
40412025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40422025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
40432025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40442025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40452025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40462025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40472025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40482025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40492025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40502025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
40512025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40522025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40532025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40542025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40552025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40562025-06-30T23:48:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40572025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40582025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40592025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40602025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40612025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40622025-06-30T23:48:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40632025-06-30T23:48:51.039ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 14 reason = Timeout
40642025-06-30T23:48:51.040ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40652025-06-30T23:48:51.040ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40662025-06-30T23:48:51.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40672025-06-30T23:48:51.040ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 675612021 } })
40682025-06-30T23:48:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40692025-06-30T23:48:51.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702025-06-30T23:48:51.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40712025-06-30T23:48:51.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.879033ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
40722025-06-30T23:48:51.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40732025-06-30T23:48:51.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40742025-06-30T23:48:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40752025-06-30T23:48:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40762025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40772025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40782025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40792025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40802025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40812025-06-30T23:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40822025-06-30T23:48:51.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 680195277 } })
40832025-06-30T23:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40842025-06-30T23:48:51.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
40852025-06-30T23:48:51.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40862025-06-30T23:48:51.045ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40872025-06-30T23:48:51.045ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40882025-06-30T23:48:51.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40892025-06-30T23:48:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40902025-06-30T23:48:51.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912025-06-30T23:48:51.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.672834ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40922025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40932025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40942025-06-30T23:48:51.048ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40952025-06-30T23:48:51.048ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40962025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 10.898482ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40972025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40982025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
40992025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41002025-06-30T23:48:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41012025-06-30T23:48:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41022025-06-30T23:48:51.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41032025-06-30T23:48:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41042025-06-30T23:48:51.070ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
41052025-06-30T23:48:51.070ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.883609ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
41062025-06-30T23:48:51.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41072025-06-30T23:48:51.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41082025-06-30T23:48:51.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41092025-06-30T23:48:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41102025-06-30T23:48:51.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41112025-06-30T23:48:51.083ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41122025-06-30T23:48:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41132025-06-30T23:48:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
41142025-06-30T23:48:51.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41152025-06-30T23:48:51.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41162025-06-30T23:48:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41172025-06-30T23:48:51.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41182025-06-30T23:48:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41192025-06-30T23:48:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41202025-06-30T23:48:51.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41212025-06-30T23:48:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41222025-06-30T23:48:51.086ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.124704ms iteration = 14 status = 0
41232025-06-30T23:48:51.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.710901ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
41242025-06-30T23:48:51.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41252025-06-30T23:48:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.161978ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41262025-06-30T23:48:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41272025-06-30T23:48:51.088ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41282025-06-30T23:48:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41292025-06-30T23:48:51.090ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 53.394755ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
41302025-06-30T23:48:51.097ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41312025-06-30T23:48:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.07255ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41322025-06-30T23:48:51.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.431686ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41332025-06-30T23:48:51.125ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
41342025-06-30T23:48:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 96.644186ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
41352025-06-30T23:48:51.130ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
41362025-06-30T23:48:51.130ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41372025-06-30T23:48:51.130ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93167b8d-174a-449e-84c0-18a133150a2b", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41382025-06-30T23:48:51.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41392025-06-30T23:48:51.133ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41402025-06-30T23:48:51.143ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
41412025-06-30T23:48:51.143ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41422025-06-30T23:48:51.144ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "421484d2-5ef0-4fc8-90c2-a3b40d956eeb", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41432025-06-30T23:48:51.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41442025-06-30T23:48:51.145ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41452025-06-30T23:48:51.153ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
41462025-06-30T23:48:51.153ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "df048511-362e-4f8a-bb56-843835c90c26", "content-length": "78", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41472025-06-30T23:48:51.153ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
41482025-06-30T23:48:51.153ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
41492025-06-30T23:48:51.153ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
41502025-06-30T23:48:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
41512025-06-30T23:48:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
41522025-06-30T23:48:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
41532025-06-30T23:48:51.156ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
41542025-06-30T23:48:51.156ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
41552025-06-30T23:48:51.156ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
41562025-06-30T23:48:51.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
41572025-06-30T23:48:51.157ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41582025-06-30T23:48:51.157ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5b015b6-43f9-4cd0-9afa-87d2cff74f82", "content-length": "26", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41592025-06-30T23:48:51.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41602025-06-30T23:48:51.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
41612025-06-30T23:48:51.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
41622025-06-30T23:48:51.159ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
41632025-06-30T23:48:51.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
41642025-06-30T23:48:51.159ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
41652025-06-30T23:48:51.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
41662025-06-30T23:48:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
41672025-06-30T23:48:51.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
41682025-06-30T23:48:51.160ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
41692025-06-30T23:48:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
41702025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
41712025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
41722025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
41732025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
41742025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "89c5f198-1cdc-4a08-a480-20e4ed0f7d27", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41752025-06-30T23:48:51.162ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "80d71fee-612e-4779-9e95-32f446ae2e82", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41762025-06-30T23:48:51.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41772025-06-30T23:48:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41782025-06-30T23:48:51.168ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41792025-06-30T23:48:51.168ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41802025-06-30T23:48:51.169ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e5d383-fbed-496e-a39e-808e74301095", "content-length": "372", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41812025-06-30T23:48:51.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41822025-06-30T23:48:51.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41832025-06-30T23:48:51.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41842025-06-30T23:48:51.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41852025-06-30T23:48:51.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41862025-06-30T23:48:51.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41872025-06-30T23:48:51.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41882025-06-30T23:48:51.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41892025-06-30T23:48:51.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902025-06-30T23:48:51.185ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41912025-06-30T23:48:51.185ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41922025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "42acb57d-6d3c-402f-b0df-4b1a188ee40a", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
41932025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41942025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41952025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41962025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41972025-06-30T23:48:51.186ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.126839ms iteration = 16 status = {"physical_disks_added":0}
41982025-06-30T23:48:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41992025-06-30T23:48:51.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42002025-06-30T23:48:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42012025-06-30T23:48:51.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42022025-06-30T23:48:51.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42032025-06-30T23:48:51.195ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42042025-06-30T23:48:51.195ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42052025-06-30T23:48:51.195ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8d7948ea-9bf9-4824-80e7-62f9d20a9a93", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
42062025-06-30T23:48:51.197ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 160.532604ms iteration = 14 status = {}
42072025-06-30T23:48:51.207ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
42082025-06-30T23:48:51.207ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
42092025-06-30T23:48:51.207ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a513c0c-5cce-4a31-b8a3-2aa6a320cc6f", "content-length": "81", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
42102025-06-30T23:48:51.209ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 170.078774ms iteration = 14 status = {"errors":[],"sps":[]}
42112025-06-30T23:48:51.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42122025-06-30T23:48:51.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42132025-06-30T23:48:51.241ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.357646ms iteration = 14 status = null
42142025-06-30T23:48:51.248ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 220.955301ms iteration = 14 status = {}
42152025-06-30T23:48:51.275ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42162025-06-30T23:48:51.276ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "174f5d15-7ba7-4031-af41-8903ab58a814", "content-length": "691", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
42172025-06-30T23:48:51.276ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42182025-06-30T23:48:51.276ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42192025-06-30T23:48:51.276ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42202025-06-30T23:48:51.278ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 249.704616ms iteration = 14 status = {}
42212025-06-30T23:48:51.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42222025-06-30T23:48:51.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42232025-06-30T23:48:51.347ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
42242025-06-30T23:48:51.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42252025-06-30T23:48:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42262025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
42272025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
42282025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42292025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42302025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42312025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42322025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42332025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42342025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42352025-06-30T23:48:51.358ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42362025-06-30T23:48:51.359ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
42372025-06-30T23:48:51.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42382025-06-30T23:48:51.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42392025-06-30T23:48:51.362ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
42402025-06-30T23:48:51.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42412025-06-30T23:48:51.463ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9a081d9f-8d1e-450f-ae4d-670401684e6f", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
42422025-06-30T23:48:51.463ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
42432025-06-30T23:48:51.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42442025-06-30T23:48:51.464ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2609a0be-27a5-4192-b0a5-77a3995d16e7", "content-length": "682", "date": "Mon, 30 Jun 2025 23:48:51 GMT"} })
42452025-06-30T23:48:51.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42462025-06-30T23:48:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42472025-06-30T23:48:51.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42482025-06-30T23:48:51.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42492025-06-30T23:48:51.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42502025-06-30T23:48:51.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42512025-06-30T23:48:51.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42522025-06-30T23:48:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42532025-06-30T23:48:51.481ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 452.349644ms iteration = 14 status = {}
42542025-06-30T23:48:51.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3588584c-83f7-4a57-90a8-513b1f24b64b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42552025-06-30T23:48:51.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3588584c-83f7-4a57-90a8-513b1f24b64b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42562025-06-30T23:48:51.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3588584c-83f7-4a57-90a8-513b1f24b64b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42572025-06-30T23:48:52.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f154021-1412-4c04-b799-fc20e5a6f931 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42582025-06-30T23:48:52.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f154021-1412-4c04-b799-fc20e5a6f931 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42592025-06-30T23:48:52.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9f154021-1412-4c04-b799-fc20e5a6f931 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42602025-06-30T23:48:53.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35f0d5c0-2984-4653-b0a7-d15f0914c32b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42612025-06-30T23:48:53.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35f0d5c0-2984-4653-b0a7-d15f0914c32b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42622025-06-30T23:48:53.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35f0d5c0-2984-4653-b0a7-d15f0914c32b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42632025-06-30T23:48:54.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 0dacb4e1-ffed-4d5c-b174-09243b88279d response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
42642025-06-30T23:48:54.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e72c4e60-5773-4766-b213-6a92d18deaf1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42652025-06-30T23:48:54.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e72c4e60-5773-4766-b213-6a92d18deaf1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42662025-06-30T23:48:54.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e72c4e60-5773-4766-b213-6a92d18deaf1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42672025-06-30T23:48:55.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5d798b2-4baf-4237-bf46-b8e27b9af814 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42682025-06-30T23:48:55.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5d798b2-4baf-4237-bf46-b8e27b9af814 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42692025-06-30T23:48:55.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5d798b2-4baf-4237-bf46-b8e27b9af814 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42702025-06-30T23:48:56.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d99da20-6ff1-43af-b60c-944a6a11dc13 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42712025-06-30T23:48:56.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d99da20-6ff1-43af-b60c-944a6a11dc13 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42722025-06-30T23:48:56.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d99da20-6ff1-43af-b60c-944a6a11dc13 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42732025-06-30T23:48:57.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = df992301-ac4a-4e2b-be30-1541e8a28e4f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42742025-06-30T23:48:57.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = df992301-ac4a-4e2b-be30-1541e8a28e4f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42752025-06-30T23:48:57.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = df992301-ac4a-4e2b-be30-1541e8a28e4f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42762025-06-30T23:48:58.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db97f631-11ae-4ba8-b0e6-91bba28943e1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42772025-06-30T23:48:58.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db97f631-11ae-4ba8-b0e6-91bba28943e1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42782025-06-30T23:48:58.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db97f631-11ae-4ba8-b0e6-91bba28943e1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42792025-06-30T23:48:59.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b13a337f-8963-44d3-bb1a-ae4b447b013d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42802025-06-30T23:48:59.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b13a337f-8963-44d3-bb1a-ae4b447b013d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42812025-06-30T23:48:59.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b13a337f-8963-44d3-bb1a-ae4b447b013d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42822025-06-30T23:49:00.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b60f4f12-755a-4cea-b4cd-a9836cf7d5ce roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42832025-06-30T23:49:00.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b60f4f12-755a-4cea-b4cd-a9836cf7d5ce resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42842025-06-30T23:49:00.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b60f4f12-755a-4cea-b4cd-a9836cf7d5ce response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
42852025-06-30T23:49:01.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
42862025-06-30T23:49:01.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42872025-06-30T23:49:01.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
42882025-06-30T23:49:01.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42892025-06-30T23:49:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42902025-06-30T23:49:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42912025-06-30T23:49:01.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42922025-06-30T23:49:01.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42932025-06-30T23:49:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42942025-06-30T23:49:01.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.142566ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42952025-06-30T23:49:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42962025-06-30T23:49:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42972025-06-30T23:49:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42982025-06-30T23:49:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42992025-06-30T23:49:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43002025-06-30T23:49:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43012025-06-30T23:49:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
43022025-06-30T23:49:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43032025-06-30T23:49:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43042025-06-30T23:49:01.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
43052025-06-30T23:49:01.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.986932ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
43062025-06-30T23:49:01.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 96ac5413-03d9-4847-b334-e78d5a228b30 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43072025-06-30T23:49:01.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 96ac5413-03d9-4847-b334-e78d5a228b30 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43082025-06-30T23:49:01.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 96ac5413-03d9-4847-b334-e78d5a228b30 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43092025-06-30T23:49:02.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf976447-9ccc-4e44-8453-165c52ce6d59 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43102025-06-30T23:49:02.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf976447-9ccc-4e44-8453-165c52ce6d59 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43112025-06-30T23:49:02.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf976447-9ccc-4e44-8453-165c52ce6d59 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43122025-06-30T23:49:03.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a764852-8766-4e02-bbb6-18a8d48e0190 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43132025-06-30T23:49:03.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a764852-8766-4e02-bbb6-18a8d48e0190 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43142025-06-30T23:49:03.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a764852-8766-4e02-bbb6-18a8d48e0190 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43152025-06-30T23:49:04.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 490 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = b640f466-a83a-43ca-9b09-fa92dd596640 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
43162025-06-30T23:49:04.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aadae4a0-f0f8-4be3-91b0-482f80d676d6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43172025-06-30T23:49:04.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aadae4a0-f0f8-4be3-91b0-482f80d676d6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43182025-06-30T23:49:04.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aadae4a0-f0f8-4be3-91b0-482f80d676d6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43192025-06-30T23:49:05.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d20006c7-b3c1-4be5-9c96-374a8cf8dd48 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43202025-06-30T23:49:05.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d20006c7-b3c1-4be5-9c96-374a8cf8dd48 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43212025-06-30T23:49:05.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d20006c7-b3c1-4be5-9c96-374a8cf8dd48 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43222025-06-30T23:49:06.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f574a6f1-c3ed-4cbd-82db-0c9f38141dd3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43232025-06-30T23:49:06.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f574a6f1-c3ed-4cbd-82db-0c9f38141dd3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43242025-06-30T23:49:06.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f574a6f1-c3ed-4cbd-82db-0c9f38141dd3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43252025-06-30T23:49:07.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b4f8917-7fba-4e42-bf8a-e16e914c283b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43262025-06-30T23:49:07.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b4f8917-7fba-4e42-bf8a-e16e914c283b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43272025-06-30T23:49:07.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b4f8917-7fba-4e42-bf8a-e16e914c283b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43282025-06-30T23:49:08.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3caa22a-b372-43c0-8614-1993385bc332 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43292025-06-30T23:49:08.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3caa22a-b372-43c0-8614-1993385bc332 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43302025-06-30T23:49:08.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3caa22a-b372-43c0-8614-1993385bc332 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43312025-06-30T23:49:09.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45017391-5872-4df1-8ee2-e5a8446cbc14 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43322025-06-30T23:49:09.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45017391-5872-4df1-8ee2-e5a8446cbc14 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43332025-06-30T23:49:09.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45017391-5872-4df1-8ee2-e5a8446cbc14 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43342025-06-30T23:49:10.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fe38ff83-b464-4701-b957-10b8cebdee96 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43352025-06-30T23:49:10.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fe38ff83-b464-4701-b957-10b8cebdee96 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43362025-06-30T23:49:10.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fe38ff83-b464-4701-b957-10b8cebdee96 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43372025-06-30T23:49:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
43382025-06-30T23:49:11.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43392025-06-30T23:49:11.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
43402025-06-30T23:49:11.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43412025-06-30T23:49:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43422025-06-30T23:49:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43432025-06-30T23:49:11.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43442025-06-30T23:49:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43452025-06-30T23:49:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43462025-06-30T23:49:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.92815ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43472025-06-30T23:49:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43482025-06-30T23:49:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43492025-06-30T23:49:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43502025-06-30T23:49:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43512025-06-30T23:49:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43522025-06-30T23:49:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532025-06-30T23:49:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
43542025-06-30T23:49:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43552025-06-30T23:49:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43562025-06-30T23:49:11.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
43572025-06-30T23:49:11.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.05864ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
43582025-06-30T23:49:11.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 893dc8ca-3075-457f-970c-5952619283bf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43592025-06-30T23:49:11.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 893dc8ca-3075-457f-970c-5952619283bf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43602025-06-30T23:49:11.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 893dc8ca-3075-457f-970c-5952619283bf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43612025-06-30T23:49:12.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f33fb4b-b33a-4f56-9549-ee72318d114e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43622025-06-30T23:49:12.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f33fb4b-b33a-4f56-9549-ee72318d114e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43632025-06-30T23:49:12.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f33fb4b-b33a-4f56-9549-ee72318d114e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43642025-06-30T23:49:13.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b5e5e635-28d5-4cb0-9f41-ba8466b0f682 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43652025-06-30T23:49:13.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b5e5e635-28d5-4cb0-9f41-ba8466b0f682 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43662025-06-30T23:49:14.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b5e5e635-28d5-4cb0-9f41-ba8466b0f682 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43672025-06-30T23:49:14.338ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 688 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 0260c5b2-00b1-467e-93d7-8140c84e65fe response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
43682025-06-30T23:49:15.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 92160082-ac9d-42ef-bc92-368c60b5f4ad roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43692025-06-30T23:49:15.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 92160082-ac9d-42ef-bc92-368c60b5f4ad resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43702025-06-30T23:49:15.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 92160082-ac9d-42ef-bc92-368c60b5f4ad response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43712025-06-30T23:49:16.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3edd352e-b6b6-467b-a380-6e52cd9c1b2c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43722025-06-30T23:49:16.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3edd352e-b6b6-467b-a380-6e52cd9c1b2c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43732025-06-30T23:49:16.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3edd352e-b6b6-467b-a380-6e52cd9c1b2c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43742025-06-30T23:49:17.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b399e5f-d79f-4f0a-9938-5159a90f095c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43752025-06-30T23:49:17.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b399e5f-d79f-4f0a-9938-5159a90f095c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43762025-06-30T23:49:17.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b399e5f-d79f-4f0a-9938-5159a90f095c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43772025-06-30T23:49:18.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f070e95-a85f-4ecf-9a92-38c374f80508 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43782025-06-30T23:49:18.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f070e95-a85f-4ecf-9a92-38c374f80508 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43792025-06-30T23:49:18.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f070e95-a85f-4ecf-9a92-38c374f80508 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43802025-06-30T23:49:19.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523fec43-6677-4c66-9970-5f87217f8d98 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43812025-06-30T23:49:19.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523fec43-6677-4c66-9970-5f87217f8d98 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43822025-06-30T23:49:19.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523fec43-6677-4c66-9970-5f87217f8d98 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43832025-06-30T23:49:19.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = b79f7f7d-d46f-4543-bdbe-e60d8f5634cc roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
43842025-06-30T23:49:19.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = b79f7f7d-d46f-4543-bdbe-e60d8f5634cc resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
43852025-06-30T23:49:19.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = b79f7f7d-d46f-4543-bdbe-e60d8f5634cc response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
43862025-06-30T23:49:19.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = eb1f967e-6dd1-44d4-9bfe-e5d83a719e63 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
43872025-06-30T23:49:19.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = eb1f967e-6dd1-44d4-9bfe-e5d83a719e63 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
43882025-06-30T23:49:19.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = eb1f967e-6dd1-44d4-9bfe-e5d83a719e63 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
43892025-06-30T23:49:20.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3b7961e-347a-4e7d-9901-ce29bd324042 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43902025-06-30T23:49:20.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3b7961e-347a-4e7d-9901-ce29bd324042 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43912025-06-30T23:49:20.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3b7961e-347a-4e7d-9901-ce29bd324042 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
43922025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
43932025-06-30T23:49:21.026ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
43942025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.64\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
43952025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
43962025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
43972025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
43982025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43992025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44002025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
44012025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44022025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
44032025-06-30T23:49:21.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:39:21.026582450 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
44042025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
44052025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
44062025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
44072025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
44082025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
44092025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44102025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44112025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
44122025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
44132025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
44142025-06-30T23:49:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
44152025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44162025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44172025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44182025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44192025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44202025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44212025-06-30T23:49:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 662841766 } })
44222025-06-30T23:49:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 662862176 } })
44232025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
44242025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
44252025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.174737ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
44262025-06-30T23:49:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.189138ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
44272025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 11 reason = Timeout
44282025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
44292025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
44302025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.241\u{b5}s iteration = 11 status = "Disabled"
44312025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
44322025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
44332025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44342025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44352025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
44362025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44372025-06-30T23:49:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
44382025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44392025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
44402025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44412025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
44422025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44432025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
44442025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44452025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
44462025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44472025-06-30T23:49:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
44482025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44492025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44502025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44512025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44522025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44532025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44542025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44552025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44562025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44572025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44582025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44592025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44602025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44612025-06-30T23:49:21.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 665308793 } })
44622025-06-30T23:49:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44632025-06-30T23:49:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
44642025-06-30T23:49:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44652025-06-30T23:49:21.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 665748363 } })
44662025-06-30T23:49:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
44672025-06-30T23:49:21.030ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:39:21.026582450 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44682025-06-30T23:49:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.142506ms iteration = 8 status = {"expiration":"2025-06-30T23:39:21.026582450Z","pruned":[]}
44692025-06-30T23:49:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.111446ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44702025-06-30T23:49:21.031ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44712025-06-30T23:49:21.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44722025-06-30T23:49:21.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44732025-06-30T23:49:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44742025-06-30T23:49:21.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44752025-06-30T23:49:21.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762025-06-30T23:49:21.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44772025-06-30T23:49:21.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-06-30T23:49:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44792025-06-30T23:49:21.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802025-06-30T23:49:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812025-06-30T23:49:21.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822025-06-30T23:49:21.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832025-06-30T23:49:21.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.948491ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44842025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44852025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44862025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44872025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44882025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44892025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44902025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44912025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44922025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44932025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
44942025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
44952025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44962025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44972025-06-30T23:49:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
44982025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44992025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
45002025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45012025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45022025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
45032025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45042025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 8 reason = Timeout
45052025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
45062025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
45072025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
45082025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
45092025-06-30T23:49:21.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45102025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45112025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
45122025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
45132025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
45142025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45152025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
45162025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45172025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
45182025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45192025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
45202025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45212025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45222025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45232025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45242025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45252025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45262025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
45272025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
45282025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45292025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45302025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45312025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
45332025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45342025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45352025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45362025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45372025-06-30T23:49:21.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45382025-06-30T23:49:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45392025-06-30T23:49:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 15 reason = Timeout
45402025-06-30T23:49:21.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 674266210 } })
45412025-06-30T23:49:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45422025-06-30T23:49:21.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45432025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45442025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45452025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45462025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45472025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45482025-06-30T23:49:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45492025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45502025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45512025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45522025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45532025-06-30T23:49:21.042ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
45542025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 12.836537ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45552025-06-30T23:49:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45562025-06-30T23:49:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45572025-06-30T23:49:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45582025-06-30T23:49:21.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45592025-06-30T23:49:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45602025-06-30T23:49:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45612025-06-30T23:49:21.044ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45622025-06-30T23:49:21.044ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45632025-06-30T23:49:21.044ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45642025-06-30T23:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45652025-06-30T23:49:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45662025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45672025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.127928ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
45682025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45692025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45702025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45712025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45722025-06-30T23:49:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.535388ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
45732025-06-30T23:49:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 9.031839ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
45742025-06-30T23:49:21.046ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
45752025-06-30T23:49:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 9.562731ms iteration = 8 status = {"by_rx":{},"error":null}
45762025-06-30T23:49:21.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-06-30T23:49:21.048ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45782025-06-30T23:49:21.048ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45792025-06-30T23:49:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.327482ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45802025-06-30T23:49:21.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45812025-06-30T23:49:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45822025-06-30T23:49:21.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45832025-06-30T23:49:21.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45842025-06-30T23:49:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45852025-06-30T23:49:21.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45862025-06-30T23:49:21.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 686127534 } })
45872025-06-30T23:49:21.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45882025-06-30T23:49:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45892025-06-30T23:49:21.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
45902025-06-30T23:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45912025-06-30T23:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922025-06-30T23:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45932025-06-30T23:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
45942025-06-30T23:49:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45952025-06-30T23:49:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
45962025-06-30T23:49:21.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972025-06-30T23:49:21.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982025-06-30T23:49:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45992025-06-30T23:49:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 18.094268ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
46002025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46012025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46022025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46032025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46042025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46052025-06-30T23:49:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46062025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46072025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46082025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46092025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
46102025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46112025-06-30T23:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46122025-06-30T23:49:21.058ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46132025-06-30T23:49:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.568089ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46142025-06-30T23:49:21.058ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46152025-06-30T23:49:21.058ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46162025-06-30T23:49:21.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46172025-06-30T23:49:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46182025-06-30T23:49:21.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46192025-06-30T23:49:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46202025-06-30T23:49:21.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46212025-06-30T23:49:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46222025-06-30T23:49:21.069ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
46232025-06-30T23:49:21.069ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46242025-06-30T23:49:21.069ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
46252025-06-30T23:49:21.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 42.634356ms iteration = 8 status = {"generation":1}
46262025-06-30T23:49:21.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
46272025-06-30T23:49:21.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.087727ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
46282025-06-30T23:49:21.080ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
46292025-06-30T23:49:21.080ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
46302025-06-30T23:49:21.080ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
46312025-06-30T23:49:21.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46322025-06-30T23:49:21.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.182338ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46332025-06-30T23:49:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46342025-06-30T23:49:21.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46352025-06-30T23:49:21.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.298367ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
46362025-06-30T23:49:21.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46372025-06-30T23:49:21.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46382025-06-30T23:49:21.086ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46392025-06-30T23:49:21.086ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46402025-06-30T23:49:21.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46412025-06-30T23:49:21.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46422025-06-30T23:49:21.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46432025-06-30T23:49:21.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46442025-06-30T23:49:21.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46452025-06-30T23:49:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 51.998983ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46462025-06-30T23:49:21.089ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46472025-06-30T23:49:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46482025-06-30T23:49:21.090ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46492025-06-30T23:49:21.090ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46502025-06-30T23:49:21.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46512025-06-30T23:49:21.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46522025-06-30T23:49:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46532025-06-30T23:49:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46542025-06-30T23:49:21.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552025-06-30T23:49:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.269818ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46562025-06-30T23:49:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46572025-06-30T23:49:21.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46582025-06-30T23:49:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46592025-06-30T23:49:21.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46602025-06-30T23:49:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46612025-06-30T23:49:21.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46622025-06-30T23:49:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46632025-06-30T23:49:21.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46642025-06-30T23:49:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
46652025-06-30T23:49:21.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46662025-06-30T23:49:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46672025-06-30T23:49:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.090783ms iteration = 15 status = 0
46682025-06-30T23:49:21.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692025-06-30T23:49:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46702025-06-30T23:49:21.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46712025-06-30T23:49:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46722025-06-30T23:49:21.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 59d1658d-a45f-4fa0-be32-d33cbec20d94 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
46732025-06-30T23:49:21.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 59d1658d-a45f-4fa0-be32-d33cbec20d94 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
46742025-06-30T23:49:21.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 59d1658d-a45f-4fa0-be32-d33cbec20d94 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
46752025-06-30T23:49:21.116ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
46762025-06-30T23:49:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 90.027793ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46772025-06-30T23:49:21.123ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.205189ms iteration = 17 status = {"physical_disks_added":0}
46782025-06-30T23:49:21.138ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46792025-06-30T23:49:21.138ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
46802025-06-30T23:49:21.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46812025-06-30T23:49:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46822025-06-30T23:49:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832025-06-30T23:49:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46842025-06-30T23:49:21.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46852025-06-30T23:49:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46862025-06-30T23:49:21.143ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
46872025-06-30T23:49:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 114.55668ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46882025-06-30T23:49:21.143ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46892025-06-30T23:49:21.143ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46902025-06-30T23:49:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.954084ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46912025-06-30T23:49:21.145ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
46922025-06-30T23:49:21.145ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46932025-06-30T23:49:21.145ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
46942025-06-30T23:49:21.145ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 118.837439ms iteration = 8 status = {"generation":2}
46952025-06-30T23:49:21.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46962025-06-30T23:49:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46972025-06-30T23:49:21.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46982025-06-30T23:49:21.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46992025-06-30T23:49:21.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47002025-06-30T23:49:21.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47012025-06-30T23:49:21.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47022025-06-30T23:49:21.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47032025-06-30T23:49:21.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042025-06-30T23:49:21.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47052025-06-30T23:49:21.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47062025-06-30T23:49:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47072025-06-30T23:49:21.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
47082025-06-30T23:49:21.224ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47092025-06-30T23:49:21.224ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47102025-06-30T23:49:21.225ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6a3ef63-5adf-4a8c-9bc8-14641c7a41b2", "content-length": "372", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47112025-06-30T23:49:21.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47122025-06-30T23:49:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47132025-06-30T23:49:21.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
47142025-06-30T23:49:21.262ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47152025-06-30T23:49:21.263ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5dde40d-63f6-49d9-bb2f-b545e39b14ba", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47162025-06-30T23:49:21.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47172025-06-30T23:49:21.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
47182025-06-30T23:49:21.264ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47192025-06-30T23:49:21.268ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
47202025-06-30T23:49:21.268ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47212025-06-30T23:49:21.268ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52bbaf65-d7b6-4739-a71a-782a6f76ab27", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47222025-06-30T23:49:21.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47232025-06-30T23:49:21.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47242025-06-30T23:49:21.272ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
47252025-06-30T23:49:21.272ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47262025-06-30T23:49:21.273ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "592999b0-c900-482c-ae5b-0bad97fc6cc9", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47272025-06-30T23:49:21.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47282025-06-30T23:49:21.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47292025-06-30T23:49:21.274ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
47302025-06-30T23:49:21.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 237.447763ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47312025-06-30T23:49:21.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47322025-06-30T23:49:21.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47332025-06-30T23:49:21.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47342025-06-30T23:49:21.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47352025-06-30T23:49:21.283ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47362025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47372025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
47382025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fe9bce81-4fb6-4b26-af97-a6e8dcac9716", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47392025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2786857-100d-4f87-8884-6e35ee05d222", "content-length": "78", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47402025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
47412025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
47422025-06-30T23:49:21.283ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
47432025-06-30T23:49:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
47442025-06-30T23:49:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
47452025-06-30T23:49:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
47462025-06-30T23:49:21.285ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
47472025-06-30T23:49:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.594811ms iteration = 15 status = {}
47482025-06-30T23:49:21.286ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
47492025-06-30T23:49:21.286ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
47502025-06-30T23:49:21.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
47512025-06-30T23:49:21.288ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
47522025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
47532025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
47542025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
47552025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
47562025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
47572025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
47582025-06-30T23:49:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
47592025-06-30T23:49:21.291ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
47602025-06-30T23:49:21.291ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
47612025-06-30T23:49:21.291ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee4efdbd-bf59-426c-bd8b-b6f281cfe8a9", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47622025-06-30T23:49:21.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
47632025-06-30T23:49:21.297ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47642025-06-30T23:49:21.298ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "806933ca-5871-4253-bdd9-97b134a1e213", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47652025-06-30T23:49:21.298ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47662025-06-30T23:49:21.299ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
47672025-06-30T23:49:21.327ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
47682025-06-30T23:49:21.327ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
47692025-06-30T23:49:21.328ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeaae7a9-f886-429a-bf0c-61b8eb9fa94f", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47702025-06-30T23:49:21.329ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
47712025-06-30T23:49:21.329ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
47722025-06-30T23:49:21.329ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0223b848-20fe-4184-9305-291b9bba1eba", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47732025-06-30T23:49:21.330ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 292.362513ms iteration = 15 status = {"errors":[],"sps":[]}
47742025-06-30T23:49:21.409ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47752025-06-30T23:49:21.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "67b58ef6-39ae-423c-b9d3-1afb2d13d894", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47762025-06-30T23:49:21.409ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47772025-06-30T23:49:21.410ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e77d6738-530f-47f4-bf02-9a90bcd9fa14", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47782025-06-30T23:49:21.410ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47792025-06-30T23:49:21.412ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
47802025-06-30T23:49:21.412ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.152133ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
47812025-06-30T23:49:21.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47822025-06-30T23:49:21.413ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.372301ms iteration = 15 status = {}
47832025-06-30T23:49:21.416ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47842025-06-30T23:49:21.416ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb052770-e54c-4d05-b5f8-91d7c9387207", "content-length": "691", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
47852025-06-30T23:49:21.416ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47862025-06-30T23:49:21.416ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47872025-06-30T23:49:21.416ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47882025-06-30T23:49:21.417ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.07995ms iteration = 15 status = {}
47892025-06-30T23:49:21.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47902025-06-30T23:49:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47912025-06-30T23:49:21.424ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 398.254202ms iteration = 15 status = null
47922025-06-30T23:49:21.454ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47932025-06-30T23:49:21.454ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3d469784-173f-4b41-9cad-65155adc7942", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47942025-06-30T23:49:21.454ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47952025-06-30T23:49:21.456ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4dfd5fa0-c608-4d73-a70c-fb6acf3daa65", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47962025-06-30T23:49:21.456ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47972025-06-30T23:49:21.457ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "17058327-e4c5-47a3-9eaa-5223858a2bc2", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47982025-06-30T23:49:21.457ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47992025-06-30T23:49:21.458ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
48002025-06-30T23:49:21.458ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 432.099626ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48012025-06-30T23:49:21.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48022025-06-30T23:49:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48032025-06-30T23:49:21.496ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
48042025-06-30T23:49:21.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48052025-06-30T23:49:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48062025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
48072025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
48082025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48092025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48102025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48112025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48122025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48132025-06-30T23:49:21.520ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48142025-06-30T23:49:21.521ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48152025-06-30T23:49:21.521ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48162025-06-30T23:49:21.521ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
48172025-06-30T23:49:21.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48182025-06-30T23:49:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48192025-06-30T23:49:21.523ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
48202025-06-30T23:49:21.523ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48212025-06-30T23:49:21.625ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c0cd20e7-1cc7-409b-a72e-c79bbe29cb1b", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
48222025-06-30T23:49:21.625ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
48232025-06-30T23:49:21.625ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48242025-06-30T23:49:21.625ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e80d970-d49a-4984-af53-126a08176858", "content-length": "682", "date": "Mon, 30 Jun 2025 23:49:21 GMT"} })
48252025-06-30T23:49:21.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48262025-06-30T23:49:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48272025-06-30T23:49:21.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48282025-06-30T23:49:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48292025-06-30T23:49:21.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302025-06-30T23:49:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48312025-06-30T23:49:21.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48322025-06-30T23:49:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48332025-06-30T23:49:21.643ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 614.165618ms iteration = 15 status = {}
48342025-06-30T23:49:22.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e29b3ca-f330-4063-9d34-b9cfad21458e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48352025-06-30T23:49:22.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e29b3ca-f330-4063-9d34-b9cfad21458e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48362025-06-30T23:49:22.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e29b3ca-f330-4063-9d34-b9cfad21458e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48372025-06-30T23:49:23.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5eaec2fd-663f-418e-8d5b-6d351214ffe2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48382025-06-30T23:49:23.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5eaec2fd-663f-418e-8d5b-6d351214ffe2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48392025-06-30T23:49:23.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5eaec2fd-663f-418e-8d5b-6d351214ffe2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48402025-06-30T23:49:24.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dfc7c46-6d66-49cb-a179-5dc51071780b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48412025-06-30T23:49:24.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dfc7c46-6d66-49cb-a179-5dc51071780b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48422025-06-30T23:49:24.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0dfc7c46-6d66-49cb-a179-5dc51071780b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48432025-06-30T23:49:24.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = b1a39527-0d1a-463e-982a-cdf546618c7e response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
48442025-06-30T23:49:25.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a88276b5-6683-4690-9fc6-d1b30f64668f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48452025-06-30T23:49:25.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a88276b5-6683-4690-9fc6-d1b30f64668f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48462025-06-30T23:49:25.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a88276b5-6683-4690-9fc6-d1b30f64668f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48472025-06-30T23:49:26.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 659062fd-ce71-4406-b950-d50258eda787 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48482025-06-30T23:49:26.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 659062fd-ce71-4406-b950-d50258eda787 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48492025-06-30T23:49:26.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 659062fd-ce71-4406-b950-d50258eda787 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48502025-06-30T23:49:27.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 53735154-db55-4b2a-879c-799b8e74620f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48512025-06-30T23:49:27.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 53735154-db55-4b2a-879c-799b8e74620f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48522025-06-30T23:49:27.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 53735154-db55-4b2a-879c-799b8e74620f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48532025-06-30T23:49:28.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f7e3aa-990d-49ad-b33e-4abdf5007391 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48542025-06-30T23:49:28.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f7e3aa-990d-49ad-b33e-4abdf5007391 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48552025-06-30T23:49:28.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f7e3aa-990d-49ad-b33e-4abdf5007391 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48562025-06-30T23:49:29.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44893888-7d2e-4616-b2d0-7f697a0c6a8e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48572025-06-30T23:49:29.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44893888-7d2e-4616-b2d0-7f697a0c6a8e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48582025-06-30T23:49:29.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44893888-7d2e-4616-b2d0-7f697a0c6a8e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48592025-06-30T23:49:30.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0fc89c5b-fe75-46e3-88f0-d33a9ab1b995 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48602025-06-30T23:49:30.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0fc89c5b-fe75-46e3-88f0-d33a9ab1b995 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48612025-06-30T23:49:30.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0fc89c5b-fe75-46e3-88f0-d33a9ab1b995 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48622025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
48632025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
48642025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48652025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48662025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48672025-06-30T23:49:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48682025-06-30T23:49:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692025-06-30T23:49:31.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48702025-06-30T23:49:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48712025-06-30T23:49:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48722025-06-30T23:49:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48732025-06-30T23:49:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48742025-06-30T23:49:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48752025-06-30T23:49:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48762025-06-30T23:49:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48772025-06-30T23:49:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
48782025-06-30T23:49:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48792025-06-30T23:49:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48802025-06-30T23:49:31.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
48812025-06-30T23:49:31.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.660731ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
48822025-06-30T23:49:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.211291ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48832025-06-30T23:49:31.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f2fb233-8157-4117-9fdd-44525745b3e1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48842025-06-30T23:49:31.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f2fb233-8157-4117-9fdd-44525745b3e1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48852025-06-30T23:49:31.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f2fb233-8157-4117-9fdd-44525745b3e1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48862025-06-30T23:49:32.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7338b436-97c4-44aa-bebb-433e495d80cb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48872025-06-30T23:49:32.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7338b436-97c4-44aa-bebb-433e495d80cb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48882025-06-30T23:49:32.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7338b436-97c4-44aa-bebb-433e495d80cb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48892025-06-30T23:49:33.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d92b5f50-25df-40bd-b5bd-5ee9422d4bd5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48902025-06-30T23:49:33.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d92b5f50-25df-40bd-b5bd-5ee9422d4bd5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48912025-06-30T23:49:33.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d92b5f50-25df-40bd-b5bd-5ee9422d4bd5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48922025-06-30T23:49:34.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 2e41e3ff-7d36-4778-b1c9-6031f59bdbc2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
48932025-06-30T23:49:34.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 2e41e3ff-7d36-4778-b1c9-6031f59bdbc2 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
48942025-06-30T23:49:34.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 2e41e3ff-7d36-4778-b1c9-6031f59bdbc2 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
48952025-06-30T23:49:34.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 12ca8db3-a751-40a6-8c26-891bf11664be roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
48962025-06-30T23:49:34.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 12ca8db3-a751-40a6-8c26-891bf11664be resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
48972025-06-30T23:49:34.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 12ca8db3-a751-40a6-8c26-891bf11664be response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
48982025-06-30T23:49:34.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1518c234-bec1-4605-b45d-bc0a350f9cdf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
48992025-06-30T23:49:34.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1518c234-bec1-4605-b45d-bc0a350f9cdf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49002025-06-30T23:49:34.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1518c234-bec1-4605-b45d-bc0a350f9cdf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49012025-06-30T23:49:34.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 441 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 003a2cbb-3e39-483a-b0a6-fecae337f25f response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
49022025-06-30T23:49:35.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a09b4a3-b1eb-4fd1-be26-1220f90e6b6f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49032025-06-30T23:49:35.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a09b4a3-b1eb-4fd1-be26-1220f90e6b6f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49042025-06-30T23:49:35.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3a09b4a3-b1eb-4fd1-be26-1220f90e6b6f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49052025-06-30T23:49:36.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f01b056f-9086-47a6-9d82-086f06c709e8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49062025-06-30T23:49:36.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f01b056f-9086-47a6-9d82-086f06c709e8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49072025-06-30T23:49:36.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f01b056f-9086-47a6-9d82-086f06c709e8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49082025-06-30T23:49:37.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 79fa58c6-3dc4-43b0-943c-f46c9822c7c2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49092025-06-30T23:49:37.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 79fa58c6-3dc4-43b0-943c-f46c9822c7c2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49102025-06-30T23:49:37.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 79fa58c6-3dc4-43b0-943c-f46c9822c7c2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49112025-06-30T23:49:38.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04c943ad-f63c-46a0-aabb-4d5cbe99efea roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49122025-06-30T23:49:38.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04c943ad-f63c-46a0-aabb-4d5cbe99efea resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49132025-06-30T23:49:38.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 04c943ad-f63c-46a0-aabb-4d5cbe99efea response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49142025-06-30T23:49:39.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6893b73e-7155-477f-95b9-f81f6e7e8997 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49152025-06-30T23:49:39.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6893b73e-7155-477f-95b9-f81f6e7e8997 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49162025-06-30T23:49:39.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6893b73e-7155-477f-95b9-f81f6e7e8997 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49172025-06-30T23:49:40.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 65f3583f-0dc7-4d2b-9868-df227b4a407a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49182025-06-30T23:49:40.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 65f3583f-0dc7-4d2b-9868-df227b4a407a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49192025-06-30T23:49:40.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 65f3583f-0dc7-4d2b-9868-df227b4a407a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49202025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
49212025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49222025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
49232025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49242025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49252025-06-30T23:49:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262025-06-30T23:49:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49272025-06-30T23:49:41.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49282025-06-30T23:49:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49292025-06-30T23:49:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49302025-06-30T23:49:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49312025-06-30T23:49:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49322025-06-30T23:49:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49332025-06-30T23:49:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49342025-06-30T23:49:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352025-06-30T23:49:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
49362025-06-30T23:49:41.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49372025-06-30T23:49:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49382025-06-30T23:49:41.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
49392025-06-30T23:49:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.513971ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
49402025-06-30T23:49:41.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.47655ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49412025-06-30T23:49:41.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aea1f88c-9f8a-4558-94a7-b43d09d6c14d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49422025-06-30T23:49:41.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aea1f88c-9f8a-4558-94a7-b43d09d6c14d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49432025-06-30T23:49:41.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = aea1f88c-9f8a-4558-94a7-b43d09d6c14d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49442025-06-30T23:49:42.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9049c575-2ae8-47b7-ae22-3ac4b1374d16 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49452025-06-30T23:49:42.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9049c575-2ae8-47b7-ae22-3ac4b1374d16 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49462025-06-30T23:49:42.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9049c575-2ae8-47b7-ae22-3ac4b1374d16 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49472025-06-30T23:49:43.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d381bf7-56c3-4c65-bc77-afdb3ee1df72 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49482025-06-30T23:49:43.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d381bf7-56c3-4c65-bc77-afdb3ee1df72 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49492025-06-30T23:49:43.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d381bf7-56c3-4c65-bc77-afdb3ee1df72 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49502025-06-30T23:49:44.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 75bf2b63-44ff-447a-be80-25c7eb4e40b1 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
49512025-06-30T23:49:44.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 241feb0d-ee96-4020-b333-e683014e3a45 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49522025-06-30T23:49:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 241feb0d-ee96-4020-b333-e683014e3a45 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49532025-06-30T23:49:44.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 241feb0d-ee96-4020-b333-e683014e3a45 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49542025-06-30T23:49:45.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 786030db-3350-42a4-83d3-f304b4fd16a1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49552025-06-30T23:49:45.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 786030db-3350-42a4-83d3-f304b4fd16a1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49562025-06-30T23:49:45.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 786030db-3350-42a4-83d3-f304b4fd16a1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49572025-06-30T23:49:46.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9b3afab2-c357-46dc-91ce-b8de0dabdb8c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49582025-06-30T23:49:46.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9b3afab2-c357-46dc-91ce-b8de0dabdb8c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49592025-06-30T23:49:46.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9b3afab2-c357-46dc-91ce-b8de0dabdb8c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49602025-06-30T23:49:47.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a97dc9b7-ad86-4a6f-8357-c7ada76aa0fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49612025-06-30T23:49:47.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a97dc9b7-ad86-4a6f-8357-c7ada76aa0fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49622025-06-30T23:49:47.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a97dc9b7-ad86-4a6f-8357-c7ada76aa0fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49632025-06-30T23:49:48.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9aa2d4ea-84e9-412c-97c0-ccb49af9cc91 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49642025-06-30T23:49:48.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9aa2d4ea-84e9-412c-97c0-ccb49af9cc91 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49652025-06-30T23:49:48.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9aa2d4ea-84e9-412c-97c0-ccb49af9cc91 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49662025-06-30T23:49:49.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 16c221e9-1bf1-47ea-97fe-a0dd481710c0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49672025-06-30T23:49:49.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 16c221e9-1bf1-47ea-97fe-a0dd481710c0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49682025-06-30T23:49:49.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 16c221e9-1bf1-47ea-97fe-a0dd481710c0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49692025-06-30T23:49:50.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5627a6b1-f7e8-4d17-940c-05cb8a3b2533 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49702025-06-30T23:49:50.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5627a6b1-f7e8-4d17-940c-05cb8a3b2533 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49712025-06-30T23:49:50.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5627a6b1-f7e8-4d17-940c-05cb8a3b2533 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
49722025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
49732025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
49742025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49752025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
49762025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49772025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49782025-06-30T23:49:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49792025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
49802025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49812025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
49822025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49832025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
49842025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
49852025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49862025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49872025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
49882025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49892025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
49902025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49912025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
49922025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49932025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
49942025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49952025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49962025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49972025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49982025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49992025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50002025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50012025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50022025-06-30T23:49:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50032025-06-30T23:49:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 665699072 } })
50042025-06-30T23:49:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
50052025-06-30T23:49:51.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.729506ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50062025-06-30T23:49:51.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 666616273 } })
50072025-06-30T23:49:51.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
50082025-06-30T23:49:51.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092025-06-30T23:49:51.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50102025-06-30T23:49:51.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112025-06-30T23:49:51.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50122025-06-30T23:49:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132025-06-30T23:49:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50142025-06-30T23:49:51.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50152025-06-30T23:49:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50162025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
50172025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
50182025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50192025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50202025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
50212025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50222025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
50232025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
50242025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
50252025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50262025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
50272025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50282025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50292025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
50302025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50312025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
50322025-06-30T23:49:51.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50332025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50342025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50352025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50362025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
50372025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50382025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50392025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50402025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50412025-06-30T23:49:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50422025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50432025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50442025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50452025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50462025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50472025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50482025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50492025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50502025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50512025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50522025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50532025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50542025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50552025-06-30T23:49:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50562025-06-30T23:49:51.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 16 reason = Timeout
50572025-06-30T23:49:51.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 674952596 } })
50582025-06-30T23:49:51.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50592025-06-30T23:49:51.039ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 2.761814ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
50602025-06-30T23:49:51.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612025-06-30T23:49:51.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50622025-06-30T23:49:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50632025-06-30T23:49:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50642025-06-30T23:49:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50652025-06-30T23:49:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50662025-06-30T23:49:51.042ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 678383295 } })
50672025-06-30T23:49:51.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50682025-06-30T23:49:51.043ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
50692025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50702025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50712025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50722025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50732025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742025-06-30T23:49:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50752025-06-30T23:49:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50762025-06-30T23:49:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
50772025-06-30T23:49:51.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50782025-06-30T23:49:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50792025-06-30T23:49:51.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
50802025-06-30T23:49:51.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.296975ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
50812025-06-30T23:49:51.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50822025-06-30T23:49:51.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50832025-06-30T23:49:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50842025-06-30T23:49:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50852025-06-30T23:49:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.688546ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
50862025-06-30T23:49:51.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50872025-06-30T23:49:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50882025-06-30T23:49:51.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50892025-06-30T23:49:51.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50902025-06-30T23:49:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50912025-06-30T23:49:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50922025-06-30T23:49:51.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.269491ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50932025-06-30T23:49:51.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.994856ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50942025-06-30T23:49:51.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.740807ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50952025-06-30T23:49:51.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50962025-06-30T23:49:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50972025-06-30T23:49:51.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.501481ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
50982025-06-30T23:49:51.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50992025-06-30T23:49:51.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51002025-06-30T23:49:51.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51012025-06-30T23:49:51.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51022025-06-30T23:49:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51032025-06-30T23:49:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
51042025-06-30T23:49:51.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51052025-06-30T23:49:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51062025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51072025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51082025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51092025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51102025-06-30T23:49:51.099ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51112025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51122025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51132025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51142025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51152025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51162025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51172025-06-30T23:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51182025-06-30T23:49:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51192025-06-30T23:49:51.100ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.083478ms iteration = 16 status = 0
51202025-06-30T23:49:51.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51212025-06-30T23:49:51.102ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51222025-06-30T23:49:51.102ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51232025-06-30T23:49:51.102ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51242025-06-30T23:49:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51252025-06-30T23:49:51.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51262025-06-30T23:49:51.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51272025-06-30T23:49:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51282025-06-30T23:49:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51292025-06-30T23:49:51.103ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51302025-06-30T23:49:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51312025-06-30T23:49:51.103ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51322025-06-30T23:49:51.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.352768ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51332025-06-30T23:49:51.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51342025-06-30T23:49:51.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51352025-06-30T23:49:51.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51362025-06-30T23:49:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51372025-06-30T23:49:51.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51382025-06-30T23:49:51.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51392025-06-30T23:49:51.138ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
51402025-06-30T23:49:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 110.487296ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51412025-06-30T23:49:51.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51422025-06-30T23:49:51.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51432025-06-30T23:49:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.341237ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51442025-06-30T23:49:51.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.704247ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
51452025-06-30T23:49:51.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
51462025-06-30T23:49:51.174ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51472025-06-30T23:49:51.174ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5430bcf8-4afa-4f44-9d45-f701e7e1ab9a", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51482025-06-30T23:49:51.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51492025-06-30T23:49:51.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51502025-06-30T23:49:51.214ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.070894ms iteration = 18 status = {"physical_disks_added":0}
51512025-06-30T23:49:51.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
51522025-06-30T23:49:51.215ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51532025-06-30T23:49:51.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43755703-05ab-49f2-9c99-f8430b805fb1", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51542025-06-30T23:49:51.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51552025-06-30T23:49:51.216ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
51562025-06-30T23:49:51.280ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51572025-06-30T23:49:51.280ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51582025-06-30T23:49:51.281ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1108204f-79fb-4eae-813b-217b53343604", "content-length": "372", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51592025-06-30T23:49:51.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51602025-06-30T23:49:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51612025-06-30T23:49:51.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
51622025-06-30T23:49:51.282ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51632025-06-30T23:49:51.283ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1437182c-b6ed-443c-9e8c-90068761fac5", "content-length": "26", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51642025-06-30T23:49:51.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51652025-06-30T23:49:51.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51662025-06-30T23:49:51.290ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51672025-06-30T23:49:51.290ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa9aef69-f14a-4c82-876a-33a312456110", "content-length": "691", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51682025-06-30T23:49:51.291ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51692025-06-30T23:49:51.291ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51702025-06-30T23:49:51.291ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51712025-06-30T23:49:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 264.927489ms iteration = 16 status = {}
51722025-06-30T23:49:51.295ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51732025-06-30T23:49:51.295ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51742025-06-30T23:49:51.295ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "78bd3dbb-950b-47ac-9c59-291fea698637", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51752025-06-30T23:49:51.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51762025-06-30T23:49:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51772025-06-30T23:49:51.296ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
51782025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e64eb53-dae1-48f3-82ab-47b6c6376dea", "content-length": "78", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
51792025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
51802025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
51812025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
51822025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
51832025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
51842025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
51852025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51862025-06-30T23:49:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51872025-06-30T23:49:51.299ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
51882025-06-30T23:49:51.299ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
51892025-06-30T23:49:51.299ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
51902025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51912025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51922025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
51932025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
51942025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
51952025-06-30T23:49:51.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
51962025-06-30T23:49:51.302ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
51972025-06-30T23:49:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
51982025-06-30T23:49:51.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
51992025-06-30T23:49:51.302ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
52002025-06-30T23:49:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
52012025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
52022025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
52032025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
52042025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
52052025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0a80ab-3b4c-4cce-bb6a-e376e5501f9e", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52062025-06-30T23:49:51.303ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "be1cf5fd-86ac-4790-86ba-3baea546b48f", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52072025-06-30T23:49:51.304ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
52082025-06-30T23:49:51.304ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
52092025-06-30T23:49:51.304ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e8ff2b2-84c6-4918-930a-ceb25aca2dc6", "content-length": "81", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52102025-06-30T23:49:51.304ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52112025-06-30T23:49:51.304ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52122025-06-30T23:49:51.304ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c854041b-ae43-4914-abd7-8d14e9748427", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52132025-06-30T23:49:51.305ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 266.917775ms iteration = 16 status = {"errors":[],"sps":[]}
52142025-06-30T23:49:51.306ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.448533ms iteration = 16 status = {}
52152025-06-30T23:49:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 304.209527ms iteration = 16 status = {}
52162025-06-30T23:49:51.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52172025-06-30T23:49:51.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52182025-06-30T23:49:51.373ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.338042ms iteration = 16 status = null
52192025-06-30T23:49:51.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52202025-06-30T23:49:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52212025-06-30T23:49:51.416ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
52222025-06-30T23:49:51.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52232025-06-30T23:49:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52242025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
52252025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
52262025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52272025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52282025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52292025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52302025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52312025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52322025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52332025-06-30T23:49:51.426ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52342025-06-30T23:49:51.427ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
52352025-06-30T23:49:51.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52362025-06-30T23:49:51.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52372025-06-30T23:49:51.429ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
52382025-06-30T23:49:51.429ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52392025-06-30T23:49:51.530ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "406adb3e-32d0-4151-bfb8-dfad22da0b3c", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52402025-06-30T23:49:51.530ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
52412025-06-30T23:49:51.530ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52422025-06-30T23:49:51.530ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "07cc365b-2277-4ccb-88ab-27193a45bf2a", "content-length": "682", "date": "Mon, 30 Jun 2025 23:49:51 GMT"} })
52432025-06-30T23:49:51.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52442025-06-30T23:49:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52452025-06-30T23:49:51.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52462025-06-30T23:49:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52472025-06-30T23:49:51.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52482025-06-30T23:49:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52492025-06-30T23:49:51.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52502025-06-30T23:49:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52512025-06-30T23:49:51.548ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.850596ms iteration = 16 status = {}
52522025-06-30T23:49:51.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 108fa66b-1b16-4a86-8db2-806816bfb5c6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52532025-06-30T23:49:51.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 108fa66b-1b16-4a86-8db2-806816bfb5c6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52542025-06-30T23:49:51.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 108fa66b-1b16-4a86-8db2-806816bfb5c6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52552025-06-30T23:49:52.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31edd2b7-e3f6-44ff-b860-d08cb352bb66 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52562025-06-30T23:49:52.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31edd2b7-e3f6-44ff-b860-d08cb352bb66 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52572025-06-30T23:49:52.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31edd2b7-e3f6-44ff-b860-d08cb352bb66 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52582025-06-30T23:49:53.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bebadfcd-b7c6-411e-918a-4cc35911e26e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52592025-06-30T23:49:53.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bebadfcd-b7c6-411e-918a-4cc35911e26e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52602025-06-30T23:49:53.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bebadfcd-b7c6-411e-918a-4cc35911e26e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52612025-06-30T23:49:54.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 500 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 1da90278-475c-47a8-a567-6bde67c80f0e response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
52622025-06-30T23:49:54.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb33c287-0700-40c4-a328-8b693489fb7c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52632025-06-30T23:49:54.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb33c287-0700-40c4-a328-8b693489fb7c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52642025-06-30T23:49:54.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb33c287-0700-40c4-a328-8b693489fb7c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52652025-06-30T23:49:55.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8f65244-3836-41fb-a057-9f71fcdfab77 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52662025-06-30T23:49:55.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8f65244-3836-41fb-a057-9f71fcdfab77 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52672025-06-30T23:49:55.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e8f65244-3836-41fb-a057-9f71fcdfab77 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52682025-06-30T23:49:56.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20b0308e-96e5-4b73-8c63-fc6ffdc9fdb9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52692025-06-30T23:49:56.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20b0308e-96e5-4b73-8c63-fc6ffdc9fdb9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52702025-06-30T23:49:56.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20b0308e-96e5-4b73-8c63-fc6ffdc9fdb9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52712025-06-30T23:49:57.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 99ae172c-7aed-494a-ad46-7ab66d51bfca roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52722025-06-30T23:49:57.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 99ae172c-7aed-494a-ad46-7ab66d51bfca resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52732025-06-30T23:49:57.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 99ae172c-7aed-494a-ad46-7ab66d51bfca response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52742025-06-30T23:49:58.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a156b56-b125-4e5a-b3e1-54e4d6968300 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52752025-06-30T23:49:58.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a156b56-b125-4e5a-b3e1-54e4d6968300 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52762025-06-30T23:49:58.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a156b56-b125-4e5a-b3e1-54e4d6968300 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52772025-06-30T23:49:59.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbbb0078-1fcb-4b64-a45a-5abc57f47829 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52782025-06-30T23:49:59.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbbb0078-1fcb-4b64-a45a-5abc57f47829 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52792025-06-30T23:49:59.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbbb0078-1fcb-4b64-a45a-5abc57f47829 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52802025-06-30T23:50:00.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3a18cd1-08d6-4e23-955b-1df0dd4d5530 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52812025-06-30T23:50:00.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3a18cd1-08d6-4e23-955b-1df0dd4d5530 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52822025-06-30T23:50:00.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3a18cd1-08d6-4e23-955b-1df0dd4d5530 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
52832025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
52842025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
52852025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52862025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52872025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52882025-06-30T23:50:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52892025-06-30T23:50:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902025-06-30T23:50:01.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52912025-06-30T23:50:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52922025-06-30T23:50:01.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.070908ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52932025-06-30T23:50:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52942025-06-30T23:50:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52952025-06-30T23:50:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52962025-06-30T23:50:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52972025-06-30T23:50:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52982025-06-30T23:50:01.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992025-06-30T23:50:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
53002025-06-30T23:50:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53012025-06-30T23:50:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022025-06-30T23:50:01.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
53032025-06-30T23:50:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.345784ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
53042025-06-30T23:50:01.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 74062403-d5e0-4514-8dce-717ca3fcabdc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53052025-06-30T23:50:01.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 74062403-d5e0-4514-8dce-717ca3fcabdc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53062025-06-30T23:50:01.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 74062403-d5e0-4514-8dce-717ca3fcabdc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53072025-06-30T23:50:02.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02a90f68-d91e-413b-a0f7-b5efc21d18d0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53082025-06-30T23:50:02.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02a90f68-d91e-413b-a0f7-b5efc21d18d0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53092025-06-30T23:50:02.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02a90f68-d91e-413b-a0f7-b5efc21d18d0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53102025-06-30T23:50:03.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e75fa7c2-19f6-4400-8969-8b6a73f749c3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53112025-06-30T23:50:03.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e75fa7c2-19f6-4400-8969-8b6a73f749c3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53122025-06-30T23:50:03.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e75fa7c2-19f6-4400-8969-8b6a73f749c3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53132025-06-30T23:50:04.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 9ffd2af6-4620-42ff-a37a-4c22bb09fa23 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
53142025-06-30T23:50:04.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 9ffd2af6-4620-42ff-a37a-4c22bb09fa23 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
53152025-06-30T23:50:04.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = 9ffd2af6-4620-42ff-a37a-4c22bb09fa23 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
53162025-06-30T23:50:04.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = e34d088b-101a-416f-a985-5deaf360361d roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
53172025-06-30T23:50:04.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = e34d088b-101a-416f-a985-5deaf360361d resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
53182025-06-30T23:50:04.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33491 req_id = e34d088b-101a-416f-a985-5deaf360361d response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
53192025-06-30T23:50:04.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 772 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 2be2a1f8-9b2c-4383-b5cf-2caee3a872d6 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
53202025-06-30T23:50:04.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2ed576bb-b8d5-4341-bb95-03c8489ab94e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53212025-06-30T23:50:04.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2ed576bb-b8d5-4341-bb95-03c8489ab94e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53222025-06-30T23:50:04.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2ed576bb-b8d5-4341-bb95-03c8489ab94e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53232025-06-30T23:50:05.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec80cc8a-012a-4522-80c3-a5b9b2a911d9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53242025-06-30T23:50:05.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec80cc8a-012a-4522-80c3-a5b9b2a911d9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53252025-06-30T23:50:05.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec80cc8a-012a-4522-80c3-a5b9b2a911d9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53262025-06-30T23:50:06.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1d56473-36b6-412f-8a8c-83e14c69d23b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53272025-06-30T23:50:06.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1d56473-36b6-412f-8a8c-83e14c69d23b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53282025-06-30T23:50:06.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1d56473-36b6-412f-8a8c-83e14c69d23b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53292025-06-30T23:50:07.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dacb0ab1-3c93-40a6-bd17-ef0ecd94f7a1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53302025-06-30T23:50:07.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dacb0ab1-3c93-40a6-bd17-ef0ecd94f7a1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53312025-06-30T23:50:07.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dacb0ab1-3c93-40a6-bd17-ef0ecd94f7a1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53322025-06-30T23:50:08.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d785a489-858e-4707-a2ba-fd2272ca53fc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53332025-06-30T23:50:08.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d785a489-858e-4707-a2ba-fd2272ca53fc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53342025-06-30T23:50:08.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d785a489-858e-4707-a2ba-fd2272ca53fc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53352025-06-30T23:50:09.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35b9ce44-034f-41bd-b2f2-1caaf1fe4b74 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53362025-06-30T23:50:09.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35b9ce44-034f-41bd-b2f2-1caaf1fe4b74 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53372025-06-30T23:50:09.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 35b9ce44-034f-41bd-b2f2-1caaf1fe4b74 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53382025-06-30T23:50:10.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20c36563-e51c-43e1-bf54-132e88bc58be roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53392025-06-30T23:50:10.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20c36563-e51c-43e1-bf54-132e88bc58be resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53402025-06-30T23:50:10.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20c36563-e51c-43e1-bf54-132e88bc58be response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53412025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
53422025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
53432025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53442025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53452025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53462025-06-30T23:50:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53472025-06-30T23:50:11.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53482025-06-30T23:50:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53492025-06-30T23:50:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502025-06-30T23:50:11.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.167183ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53512025-06-30T23:50:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53522025-06-30T23:50:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53532025-06-30T23:50:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53542025-06-30T23:50:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53552025-06-30T23:50:11.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53562025-06-30T23:50:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572025-06-30T23:50:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
53582025-06-30T23:50:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53592025-06-30T23:50:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53602025-06-30T23:50:11.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
53612025-06-30T23:50:11.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.17141ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
53622025-06-30T23:50:11.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a8ab77f-8128-4a45-b45c-3e7127db02fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53632025-06-30T23:50:11.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a8ab77f-8128-4a45-b45c-3e7127db02fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53642025-06-30T23:50:11.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a8ab77f-8128-4a45-b45c-3e7127db02fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53652025-06-30T23:50:12.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d94fbe3b-9bda-4842-92f4-412de40c0cfe roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53662025-06-30T23:50:12.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d94fbe3b-9bda-4842-92f4-412de40c0cfe resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53672025-06-30T23:50:12.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d94fbe3b-9bda-4842-92f4-412de40c0cfe response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53682025-06-30T23:50:13.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 85562664-c1f3-4f66-8d5b-091dbf371e6c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53692025-06-30T23:50:13.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 85562664-c1f3-4f66-8d5b-091dbf371e6c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53702025-06-30T23:50:13.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 85562664-c1f3-4f66-8d5b-091dbf371e6c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53712025-06-30T23:50:14.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 804 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = e7ae862d-50dc-4235-a3bd-c5ddbb63b1c8 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
53722025-06-30T23:50:14.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ce4ed9f-27ec-4b92-8729-06a30159c38d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53732025-06-30T23:50:14.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ce4ed9f-27ec-4b92-8729-06a30159c38d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53742025-06-30T23:50:14.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ce4ed9f-27ec-4b92-8729-06a30159c38d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53752025-06-30T23:50:15.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5aad4c9-d133-47f8-82b7-37ccbfed2887 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53762025-06-30T23:50:15.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5aad4c9-d133-47f8-82b7-37ccbfed2887 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53772025-06-30T23:50:15.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c5aad4c9-d133-47f8-82b7-37ccbfed2887 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53782025-06-30T23:50:17.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4aea728b-6ebd-4684-b694-f92411b32888 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53792025-06-30T23:50:17.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4aea728b-6ebd-4684-b694-f92411b32888 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53802025-06-30T23:50:17.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4aea728b-6ebd-4684-b694-f92411b32888 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53812025-06-30T23:50:18.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28d5a268-1b5c-4160-a52e-0c50b1153c57 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53822025-06-30T23:50:18.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28d5a268-1b5c-4160-a52e-0c50b1153c57 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53832025-06-30T23:50:18.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 28d5a268-1b5c-4160-a52e-0c50b1153c57 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53842025-06-30T23:50:19.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e044088-cc51-4059-acb1-46910df5d579 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53852025-06-30T23:50:19.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e044088-cc51-4059-acb1-46910df5d579 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53862025-06-30T23:50:19.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5e044088-cc51-4059-acb1-46910df5d579 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53872025-06-30T23:50:20.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31e413aa-70cf-468d-806f-95cedc0bdce5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53882025-06-30T23:50:20.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31e413aa-70cf-468d-806f-95cedc0bdce5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53892025-06-30T23:50:20.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31e413aa-70cf-468d-806f-95cedc0bdce5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
53902025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
53912025-06-30T23:50:21.026ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
53922025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
53932025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53942025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 31.611\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
53952025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53962025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
53972025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
53982025-06-30T23:50:21.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:40:21.026295129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53992025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54002025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
54012025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
54022025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
54032025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
54042025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54052025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
54062025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
54072025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54082025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54092025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
54102025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
54112025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54122025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
54132025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54142025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54152025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54162025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54172025-06-30T23:50:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54182025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54192025-06-30T23:50:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 662800074 } })
54202025-06-30T23:50:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 662795674 } })
54212025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
54222025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.136376ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
54232025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
54242025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.217068ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
54252025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54262025-06-30T23:50:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54272025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 12 reason = Timeout
54282025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
54292025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.47\u{b5}s iteration = 12 status = "Disabled"
54302025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
54312025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
54322025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54332025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
54342025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
54352025-06-30T23:50:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
54362025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54372025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54382025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
54392025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54402025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
54412025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54422025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54432025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
54442025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54452025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
54462025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54472025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
54482025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54492025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54502025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54512025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54522025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54532025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54542025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54552025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54562025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54572025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54582025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54592025-06-30T23:50:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54602025-06-30T23:50:21.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 665161889 } })
54612025-06-30T23:50:21.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
54622025-06-30T23:50:21.030ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:40:21.026295129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54632025-06-30T23:50:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.427933ms iteration = 9 status = {"expiration":"2025-06-30T23:40:21.026295129Z","pruned":[]}
54642025-06-30T23:50:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.509494ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54652025-06-30T23:50:21.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 667040313 } })
54662025-06-30T23:50:21.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672025-06-30T23:50:21.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
54682025-06-30T23:50:21.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692025-06-30T23:50:21.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702025-06-30T23:50:21.032ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712025-06-30T23:50:21.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54722025-06-30T23:50:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54732025-06-30T23:50:21.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742025-06-30T23:50:21.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54752025-06-30T23:50:21.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54762025-06-30T23:50:21.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54772025-06-30T23:50:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54782025-06-30T23:50:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792025-06-30T23:50:21.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802025-06-30T23:50:21.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
54822025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
54832025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54842025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54852025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
54862025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54872025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
54882025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
54892025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54902025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54912025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
54922025-06-30T23:50:21.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54932025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
54942025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54952025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
54962025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54972025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
54982025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54992025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55002025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55012025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 9 reason = Timeout
55022025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
55032025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
55042025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55052025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
55062025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
55072025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
55082025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
55092025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
55102025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
55112025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55122025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55132025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55142025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55152025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55162025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55172025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55182025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
55192025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55202025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55212025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
55222025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55232025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55242025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
55252025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55262025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
55272025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55282025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
55292025-06-30T23:50:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55302025-06-30T23:50:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55312025-06-30T23:50:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55322025-06-30T23:50:21.037ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55332025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55342025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.001786ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
55352025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55362025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55372025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55382025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55392025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55402025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55412025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55422025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55432025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 17 reason = Timeout
55442025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55452025-06-30T23:50:21.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55462025-06-30T23:50:21.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 674818973 } })
55472025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55482025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55492025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55502025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.624264ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
55512025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55522025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55532025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55542025-06-30T23:50:21.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552025-06-30T23:50:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55562025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.991235ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
55572025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55582025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55592025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55602025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55612025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55622025-06-30T23:50:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55632025-06-30T23:50:21.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55642025-06-30T23:50:21.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55652025-06-30T23:50:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55662025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55672025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55682025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55692025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55702025-06-30T23:50:21.043ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
55712025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 7.136346ms iteration = 9 status = {"by_rx":{},"error":null}
55722025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55732025-06-30T23:50:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55742025-06-30T23:50:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55752025-06-30T23:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55762025-06-30T23:50:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55772025-06-30T23:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55782025-06-30T23:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55792025-06-30T23:50:21.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55802025-06-30T23:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55812025-06-30T23:50:21.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 683411751 } })
55822025-06-30T23:50:21.048ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
55832025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55842025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55852025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
55862025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55872025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
55892025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.568001ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55902025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55912025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55922025-06-30T23:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55932025-06-30T23:50:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55942025-06-30T23:50:21.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952025-06-30T23:50:21.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55962025-06-30T23:50:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 15.488159ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
55972025-06-30T23:50:21.051ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55982025-06-30T23:50:21.051ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55992025-06-30T23:50:21.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56002025-06-30T23:50:21.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56012025-06-30T23:50:21.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56022025-06-30T23:50:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56032025-06-30T23:50:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56042025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56052025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56062025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56072025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56082025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56092025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102025-06-30T23:50:21.053ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56112025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.479105ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56122025-06-30T23:50:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56132025-06-30T23:50:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
56142025-06-30T23:50:21.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56152025-06-30T23:50:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56162025-06-30T23:50:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56172025-06-30T23:50:21.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56182025-06-30T23:50:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56192025-06-30T23:50:21.063ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
56202025-06-30T23:50:21.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56212025-06-30T23:50:21.063ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
56222025-06-30T23:50:21.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 37.419345ms iteration = 9 status = {"generation":1}
56232025-06-30T23:50:21.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3afee17e-7bd7-457d-8f3a-02ffd2c6dd6b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
56242025-06-30T23:50:21.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3afee17e-7bd7-457d-8f3a-02ffd2c6dd6b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
56252025-06-30T23:50:21.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3afee17e-7bd7-457d-8f3a-02ffd2c6dd6b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
56262025-06-30T23:50:21.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.79525ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56272025-06-30T23:50:21.087ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56282025-06-30T23:50:21.087ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
56292025-06-30T23:50:21.087ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 59.415335ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56302025-06-30T23:50:21.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56312025-06-30T23:50:21.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56322025-06-30T23:50:21.090ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
56332025-06-30T23:50:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.067516ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
56342025-06-30T23:50:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.28324ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56352025-06-30T23:50:21.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56362025-06-30T23:50:21.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56372025-06-30T23:50:21.097ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56382025-06-30T23:50:21.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56392025-06-30T23:50:21.098ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56402025-06-30T23:50:21.099ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
56412025-06-30T23:50:21.099ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
56422025-06-30T23:50:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.491399ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
56432025-06-30T23:50:21.100ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56442025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56452025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56462025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.069192ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56472025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56482025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56492025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56502025-06-30T23:50:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.657756ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
56512025-06-30T23:50:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56522025-06-30T23:50:21.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56532025-06-30T23:50:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56542025-06-30T23:50:21.102ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
56552025-06-30T23:50:21.102ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 74.646767ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56562025-06-30T23:50:21.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56572025-06-30T23:50:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56582025-06-30T23:50:21.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56592025-06-30T23:50:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56602025-06-30T23:50:21.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56612025-06-30T23:50:21.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56622025-06-30T23:50:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56632025-06-30T23:50:21.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56642025-06-30T23:50:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56652025-06-30T23:50:21.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662025-06-30T23:50:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
56672025-06-30T23:50:21.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56682025-06-30T23:50:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56692025-06-30T23:50:21.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702025-06-30T23:50:21.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56712025-06-30T23:50:21.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56722025-06-30T23:50:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56732025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.906024ms iteration = 17 status = 0
56742025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56752025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56762025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56772025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 85.344845ms iteration = 19 status = {"physical_disks_added":0}
56782025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56792025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
56802025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56812025-06-30T23:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56822025-06-30T23:50:21.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832025-06-30T23:50:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56842025-06-30T23:50:21.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56852025-06-30T23:50:21.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56862025-06-30T23:50:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56872025-06-30T23:50:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56882025-06-30T23:50:21.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56892025-06-30T23:50:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56902025-06-30T23:50:21.120ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
56912025-06-30T23:50:21.120ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56922025-06-30T23:50:21.120ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
56932025-06-30T23:50:21.120ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 94.449665ms iteration = 9 status = {"generation":2}
56942025-06-30T23:50:21.136ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56952025-06-30T23:50:21.136ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56962025-06-30T23:50:21.136ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56972025-06-30T23:50:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56982025-06-30T23:50:21.152ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
56992025-06-30T23:50:21.152ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 125.79319ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
57002025-06-30T23:50:21.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57012025-06-30T23:50:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57022025-06-30T23:50:21.179ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57032025-06-30T23:50:21.179ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57042025-06-30T23:50:21.179ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.716605ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57052025-06-30T23:50:21.247ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57062025-06-30T23:50:21.247ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57072025-06-30T23:50:21.248ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0009817-20a4-4225-96b1-f92996771fbe", "content-length": "372", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57082025-06-30T23:50:21.248ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57092025-06-30T23:50:21.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57102025-06-30T23:50:21.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57112025-06-30T23:50:21.263ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57122025-06-30T23:50:21.263ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57132025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
57142025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "aa984496-ba24-49f8-8734-782691c67513", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57152025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57162025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57172025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c7b0799-3e24-4cf7-ab57-329d86af065c", "content-length": "78", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57182025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
57192025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
57202025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
57212025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
57222025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
57232025-06-30T23:50:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
57242025-06-30T23:50:21.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
57252025-06-30T23:50:21.265ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57262025-06-30T23:50:21.265ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b3892ad-0988-445f-a691-f7d77e4c3e46", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57272025-06-30T23:50:21.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57282025-06-30T23:50:21.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
57292025-06-30T23:50:21.266ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
57302025-06-30T23:50:21.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57312025-06-30T23:50:21.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57322025-06-30T23:50:21.267ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
57332025-06-30T23:50:21.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57342025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
57352025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
57362025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
57372025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
57382025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
57392025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
57402025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
57412025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
57422025-06-30T23:50:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
57432025-06-30T23:50:21.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57442025-06-30T23:50:21.270ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
57452025-06-30T23:50:21.270ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
57462025-06-30T23:50:21.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57472025-06-30T23:50:21.270ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "782e996f-6842-401a-b8d9-6de9e54d2be4", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57482025-06-30T23:50:21.273ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
57492025-06-30T23:50:21.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 236.798127ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57502025-06-30T23:50:21.273ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57512025-06-30T23:50:21.273ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57522025-06-30T23:50:21.274ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f1c82c1b-4688-4abf-ad18-2e0f112139af", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57532025-06-30T23:50:21.276ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 239.968801ms iteration = 17 status = {}
57542025-06-30T23:50:21.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
57552025-06-30T23:50:21.295ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57562025-06-30T23:50:21.295ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1fa6b16-4f7d-47a6-af72-0677b6640090", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57572025-06-30T23:50:21.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57582025-06-30T23:50:21.296ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
57592025-06-30T23:50:21.306ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
57602025-06-30T23:50:21.306ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
57612025-06-30T23:50:21.306ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "973123fc-405b-4372-b7a2-098c18e65d34", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57622025-06-30T23:50:21.309ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
57632025-06-30T23:50:21.309ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
57642025-06-30T23:50:21.309ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5bdee47-034e-4526-aa8b-a3c99c109ddb", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57652025-06-30T23:50:21.311ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 272.77652ms iteration = 17 status = {"errors":[],"sps":[]}
57662025-06-30T23:50:21.354ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
57672025-06-30T23:50:21.372ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
57682025-06-30T23:50:21.372ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57692025-06-30T23:50:21.372ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "573c2a42-a8b9-45e9-811d-ac98ce3f9aad", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57702025-06-30T23:50:21.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57712025-06-30T23:50:21.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57722025-06-30T23:50:21.374ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57732025-06-30T23:50:21.375ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "93606a41-de80-4c3a-844c-45ef8a7d1398", "content-length": "691", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
57742025-06-30T23:50:21.375ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57752025-06-30T23:50:21.375ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
57762025-06-30T23:50:21.375ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
57772025-06-30T23:50:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.395959ms iteration = 17 status = {}
57782025-06-30T23:50:21.473ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
57792025-06-30T23:50:21.473ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2b399c15-7e00-45b1-9cc9-bea8e2271ed5", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57802025-06-30T23:50:21.473ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57812025-06-30T23:50:21.475ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "05229f97-7244-44d1-8e4f-ad70364544ac", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57822025-06-30T23:50:21.475ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57832025-06-30T23:50:21.477ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
57842025-06-30T23:50:21.477ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 451.402303ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57852025-06-30T23:50:21.483ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.404761ms iteration = 17 status = {}
57862025-06-30T23:50:21.527ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57872025-06-30T23:50:21.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57882025-06-30T23:50:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57892025-06-30T23:50:21.534ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 508.267108ms iteration = 17 status = null
57902025-06-30T23:50:21.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57912025-06-30T23:50:21.593ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f5f8ca7d-4b31-4642-84bf-a74e1e002ffe", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57922025-06-30T23:50:21.593ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57932025-06-30T23:50:21.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9be343e0-62ba-44aa-9e6f-f397a15ef236", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57942025-06-30T23:50:21.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57952025-06-30T23:50:21.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "28d41d17-1fa0-46fd-9971-451a4d1b9b9a", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57962025-06-30T23:50:21.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57972025-06-30T23:50:21.598ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57982025-06-30T23:50:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 571.769387ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57992025-06-30T23:50:21.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58002025-06-30T23:50:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58012025-06-30T23:50:21.605ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
58022025-06-30T23:50:21.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58032025-06-30T23:50:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58042025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
58052025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
58062025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58072025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58082025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58092025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58102025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58112025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58122025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58132025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58142025-06-30T23:50:21.619ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
58152025-06-30T23:50:21.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58162025-06-30T23:50:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58172025-06-30T23:50:21.622ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
58182025-06-30T23:50:21.622ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58192025-06-30T23:50:21.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5f1bcfd7-8768-43b4-9142-e14bc1d1b312", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
58202025-06-30T23:50:21.721ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
58212025-06-30T23:50:21.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58222025-06-30T23:50:21.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "adac6537-ae13-495c-a6fd-d4764da51baf", "content-length": "682", "date": "Mon, 30 Jun 2025 23:50:21 GMT"} })
58232025-06-30T23:50:21.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58242025-06-30T23:50:21.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58252025-06-30T23:50:21.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58262025-06-30T23:50:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58272025-06-30T23:50:21.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58282025-06-30T23:50:21.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58292025-06-30T23:50:21.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58302025-06-30T23:50:21.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58312025-06-30T23:50:21.739ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 711.690404ms iteration = 17 status = {}
58322025-06-30T23:50:22.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff613ef3-ded3-41ba-8d23-450cbc2146e3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58332025-06-30T23:50:22.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff613ef3-ded3-41ba-8d23-450cbc2146e3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58342025-06-30T23:50:22.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff613ef3-ded3-41ba-8d23-450cbc2146e3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58352025-06-30T23:50:23.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ce33497a-2e23-41fe-a69b-076130f99fd8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58362025-06-30T23:50:23.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ce33497a-2e23-41fe-a69b-076130f99fd8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58372025-06-30T23:50:23.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ce33497a-2e23-41fe-a69b-076130f99fd8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58382025-06-30T23:50:24.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 358ba4f9-5d6e-4d09-85ba-e855f50581fc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58392025-06-30T23:50:24.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 358ba4f9-5d6e-4d09-85ba-e855f50581fc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58402025-06-30T23:50:24.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 358ba4f9-5d6e-4d09-85ba-e855f50581fc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58412025-06-30T23:50:24.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 482 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = fe1cbd5d-1ef2-48ab-a647-48492d2dfabb response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
58422025-06-30T23:50:25.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c02fa22c-4ba7-4371-a394-c2ec73311008 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58432025-06-30T23:50:25.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c02fa22c-4ba7-4371-a394-c2ec73311008 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58442025-06-30T23:50:25.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c02fa22c-4ba7-4371-a394-c2ec73311008 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58452025-06-30T23:50:26.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 11c2ddbb-6cd0-4f5c-a299-2243a24711b9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58462025-06-30T23:50:26.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 11c2ddbb-6cd0-4f5c-a299-2243a24711b9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58472025-06-30T23:50:26.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 11c2ddbb-6cd0-4f5c-a299-2243a24711b9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58482025-06-30T23:50:27.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a974788-b8ba-480e-915f-fb7a411406c6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58492025-06-30T23:50:27.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a974788-b8ba-480e-915f-fb7a411406c6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58502025-06-30T23:50:27.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6a974788-b8ba-480e-915f-fb7a411406c6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58512025-06-30T23:50:28.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8264c39a-56de-42ae-ac73-03d9bfb30de3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58522025-06-30T23:50:28.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8264c39a-56de-42ae-ac73-03d9bfb30de3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58532025-06-30T23:50:28.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8264c39a-56de-42ae-ac73-03d9bfb30de3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58542025-06-30T23:50:29.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 850946c9-bbe0-4156-8424-40f4eee613e4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58552025-06-30T23:50:29.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 850946c9-bbe0-4156-8424-40f4eee613e4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58562025-06-30T23:50:29.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 850946c9-bbe0-4156-8424-40f4eee613e4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58572025-06-30T23:50:30.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f916d911-6d75-465a-ad97-0aaf790ae734 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58582025-06-30T23:50:30.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f916d911-6d75-465a-ad97-0aaf790ae734 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58592025-06-30T23:50:30.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f916d911-6d75-465a-ad97-0aaf790ae734 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58602025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
58612025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58622025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
58632025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58642025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58652025-06-30T23:50:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58662025-06-30T23:50:31.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672025-06-30T23:50:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58682025-06-30T23:50:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58692025-06-30T23:50:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58702025-06-30T23:50:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58712025-06-30T23:50:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58722025-06-30T23:50:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58732025-06-30T23:50:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
58742025-06-30T23:50:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58752025-06-30T23:50:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58762025-06-30T23:50:31.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
58772025-06-30T23:50:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.851472ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
58782025-06-30T23:50:31.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58792025-06-30T23:50:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58802025-06-30T23:50:31.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.513374ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58812025-06-30T23:50:31.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c89fea3f-def6-4088-862d-3fe6d45f997c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58822025-06-30T23:50:31.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c89fea3f-def6-4088-862d-3fe6d45f997c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58832025-06-30T23:50:31.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c89fea3f-def6-4088-862d-3fe6d45f997c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58842025-06-30T23:50:32.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fbe4414e-2ac8-4792-92cb-522bab0aa7de roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58852025-06-30T23:50:32.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fbe4414e-2ac8-4792-92cb-522bab0aa7de resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58862025-06-30T23:50:32.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fbe4414e-2ac8-4792-92cb-522bab0aa7de response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58872025-06-30T23:50:33.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 399a69d2-c4cd-489e-b32f-f7c915b869c6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58882025-06-30T23:50:33.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 399a69d2-c4cd-489e-b32f-f7c915b869c6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58892025-06-30T23:50:33.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 399a69d2-c4cd-489e-b32f-f7c915b869c6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58902025-06-30T23:50:34.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 790d1fb7-a15f-4f8e-b6d5-3c02dcf21101 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58912025-06-30T23:50:34.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 790d1fb7-a15f-4f8e-b6d5-3c02dcf21101 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58922025-06-30T23:50:34.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 790d1fb7-a15f-4f8e-b6d5-3c02dcf21101 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58932025-06-30T23:50:34.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 707 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 07abafaa-3c6f-46d2-b3ad-c727d644c9af response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
58942025-06-30T23:50:35.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de1620b3-ee9f-4206-a0a8-9736e05d4ba3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58952025-06-30T23:50:35.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de1620b3-ee9f-4206-a0a8-9736e05d4ba3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58962025-06-30T23:50:35.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de1620b3-ee9f-4206-a0a8-9736e05d4ba3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58972025-06-30T23:50:36.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5c613988-2f45-42cb-a8f4-6d680b26f8b4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58982025-06-30T23:50:36.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5c613988-2f45-42cb-a8f4-6d680b26f8b4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
58992025-06-30T23:50:36.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5c613988-2f45-42cb-a8f4-6d680b26f8b4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59002025-06-30T23:50:37.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d336896f-882c-48b8-b0af-96b25faad937 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59012025-06-30T23:50:37.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d336896f-882c-48b8-b0af-96b25faad937 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59022025-06-30T23:50:37.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d336896f-882c-48b8-b0af-96b25faad937 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59032025-06-30T23:50:38.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f6d74ba-a66c-4870-87fc-1626fd9fe734 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59042025-06-30T23:50:38.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f6d74ba-a66c-4870-87fc-1626fd9fe734 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59052025-06-30T23:50:38.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0f6d74ba-a66c-4870-87fc-1626fd9fe734 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59062025-06-30T23:50:39.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d599d90-6032-4470-b7ed-532a3aceba3e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59072025-06-30T23:50:39.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d599d90-6032-4470-b7ed-532a3aceba3e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59082025-06-30T23:50:39.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5d599d90-6032-4470-b7ed-532a3aceba3e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59092025-06-30T23:50:40.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b8d6ef3-6182-4d4a-91a8-c6e322f61397 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59102025-06-30T23:50:40.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b8d6ef3-6182-4d4a-91a8-c6e322f61397 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59112025-06-30T23:50:40.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b8d6ef3-6182-4d4a-91a8-c6e322f61397 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59122025-06-30T23:50:41.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
59132025-06-30T23:50:41.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
59142025-06-30T23:50:41.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59152025-06-30T23:50:41.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59162025-06-30T23:50:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59172025-06-30T23:50:41.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59182025-06-30T23:50:41.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59192025-06-30T23:50:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59202025-06-30T23:50:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59212025-06-30T23:50:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59222025-06-30T23:50:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59232025-06-30T23:50:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59242025-06-30T23:50:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252025-06-30T23:50:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
59262025-06-30T23:50:41.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59272025-06-30T23:50:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59282025-06-30T23:50:41.057ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
59292025-06-30T23:50:41.057ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.835477ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
59302025-06-30T23:50:41.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59312025-06-30T23:50:41.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59322025-06-30T23:50:41.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.779157ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59332025-06-30T23:50:41.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29619e3a-7a7d-4615-89e6-97d7ed6704aa roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59342025-06-30T23:50:41.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29619e3a-7a7d-4615-89e6-97d7ed6704aa resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59352025-06-30T23:50:41.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 29619e3a-7a7d-4615-89e6-97d7ed6704aa response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59362025-06-30T23:50:42.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d98f126-4ade-478a-b2b7-5125b9c04981 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59372025-06-30T23:50:42.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d98f126-4ade-478a-b2b7-5125b9c04981 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59382025-06-30T23:50:42.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d98f126-4ade-478a-b2b7-5125b9c04981 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59392025-06-30T23:50:43.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17a7de45-e360-49f3-b55b-c9a77b4965f1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59402025-06-30T23:50:43.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17a7de45-e360-49f3-b55b-c9a77b4965f1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59412025-06-30T23:50:43.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 17a7de45-e360-49f3-b55b-c9a77b4965f1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59422025-06-30T23:50:44.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 715a9bfc-4142-4c00-a829-c8a768212f43 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
59432025-06-30T23:50:44.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a134cc67-c324-4c60-8614-d93dcc2ecaa4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59442025-06-30T23:50:44.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a134cc67-c324-4c60-8614-d93dcc2ecaa4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59452025-06-30T23:50:44.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a134cc67-c324-4c60-8614-d93dcc2ecaa4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59462025-06-30T23:50:45.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 047288de-2425-4d92-a29b-2eecc92d580e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59472025-06-30T23:50:45.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 047288de-2425-4d92-a29b-2eecc92d580e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59482025-06-30T23:50:45.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 047288de-2425-4d92-a29b-2eecc92d580e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59492025-06-30T23:50:46.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20174ded-3200-4ea0-955d-d9cfee36e0ca roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59502025-06-30T23:50:46.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20174ded-3200-4ea0-955d-d9cfee36e0ca resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59512025-06-30T23:50:46.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 20174ded-3200-4ea0-955d-d9cfee36e0ca response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59522025-06-30T23:50:47.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db1738d5-6777-4981-b24f-97fdd6282628 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59532025-06-30T23:50:47.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db1738d5-6777-4981-b24f-97fdd6282628 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59542025-06-30T23:50:47.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = db1738d5-6777-4981-b24f-97fdd6282628 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59552025-06-30T23:50:48.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68052622-a7f2-4b38-8852-032144a2b6c9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59562025-06-30T23:50:48.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68052622-a7f2-4b38-8852-032144a2b6c9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59572025-06-30T23:50:48.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 68052622-a7f2-4b38-8852-032144a2b6c9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59582025-06-30T23:50:49.321ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:54332
59592025-06-30T23:50:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = f04bec6c-0364-4aa5-ba6e-174d467a9b9c roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
59602025-06-30T23:50:49.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = f04bec6c-0364-4aa5-ba6e-174d467a9b9c resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
59612025-06-30T23:50:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = f04bec6c-0364-4aa5-ba6e-174d467a9b9c response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
59622025-06-30T23:50:49.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = a7ec2bef-7ef5-4399-8857-2d997fdb2017 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
59632025-06-30T23:50:49.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = a7ec2bef-7ef5-4399-8857-2d997fdb2017 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
59642025-06-30T23:50:49.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54332 req_id = a7ec2bef-7ef5-4399-8857-2d997fdb2017 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
59652025-06-30T23:50:49.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bdd1755b-4308-472f-a121-8d579a6a4515 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59662025-06-30T23:50:49.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bdd1755b-4308-472f-a121-8d579a6a4515 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59672025-06-30T23:50:49.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bdd1755b-4308-472f-a121-8d579a6a4515 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59682025-06-30T23:50:50.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b490f7b-05e1-4327-b24b-fc362b8212cd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59692025-06-30T23:50:50.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b490f7b-05e1-4327-b24b-fc362b8212cd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59702025-06-30T23:50:50.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b490f7b-05e1-4327-b24b-fc362b8212cd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
59712025-06-30T23:50:51.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
59722025-06-30T23:50:51.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
59732025-06-30T23:50:51.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
59742025-06-30T23:50:51.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59752025-06-30T23:50:51.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59762025-06-30T23:50:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59772025-06-30T23:50:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59782025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
59792025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
59802025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
59812025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59822025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59832025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
59842025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59852025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
59872025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
59882025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59892025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59902025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
59912025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
59922025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59932025-06-30T23:50:51.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59942025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59952025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59962025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59972025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59982025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59992025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60002025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60012025-06-30T23:50:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60022025-06-30T23:50:51.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 665500887 } })
60032025-06-30T23:50:51.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 665527268 } })
60042025-06-30T23:50:51.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
60052025-06-30T23:50:51.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
60062025-06-30T23:50:51.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60072025-06-30T23:50:51.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.663795ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60082025-06-30T23:50:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60092025-06-30T23:50:51.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60102025-06-30T23:50:51.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60112025-06-30T23:50:51.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60122025-06-30T23:50:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60132025-06-30T23:50:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60142025-06-30T23:50:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60152025-06-30T23:50:51.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60162025-06-30T23:50:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.398865ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60172025-06-30T23:50:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60182025-06-30T23:50:51.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60192025-06-30T23:50:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.244144ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60202025-06-30T23:50:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60212025-06-30T23:50:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60222025-06-30T23:50:51.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60232025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60242025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
60252025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
60262025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
60272025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60282025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60292025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60302025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60312025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
60322025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60332025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
60342025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60352025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60362025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60372025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
60382025-06-30T23:50:51.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60392025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60402025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
60412025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60422025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
60432025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
60442025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60452025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60462025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60472025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60482025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60492025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60502025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60512025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60522025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60532025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
60542025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60552025-06-30T23:50:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60562025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60572025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60582025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60592025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60602025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60612025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60622025-06-30T23:50:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60632025-06-30T23:50:51.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
60642025-06-30T23:50:51.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60652025-06-30T23:50:51.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 675107049 } })
60662025-06-30T23:50:51.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.294406ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
60672025-06-30T23:50:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60682025-06-30T23:50:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60692025-06-30T23:50:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60702025-06-30T23:50:51.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60712025-06-30T23:50:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60722025-06-30T23:50:51.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60732025-06-30T23:50:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60742025-06-30T23:50:51.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60752025-06-30T23:50:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60762025-06-30T23:50:51.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60772025-06-30T23:50:51.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60782025-06-30T23:50:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60792025-06-30T23:50:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60802025-06-30T23:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60812025-06-30T23:50:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60822025-06-30T23:50:51.046ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 682665404 } })
60832025-06-30T23:50:51.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
60842025-06-30T23:50:51.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.487026ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60852025-06-30T23:50:51.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862025-06-30T23:50:51.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60872025-06-30T23:50:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60882025-06-30T23:50:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60892025-06-30T23:50:51.053ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60902025-06-30T23:50:51.053ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.421223ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60912025-06-30T23:50:51.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60922025-06-30T23:50:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60932025-06-30T23:50:51.082ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942025-06-30T23:50:51.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60952025-06-30T23:50:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60962025-06-30T23:50:51.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60972025-06-30T23:50:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60982025-06-30T23:50:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60992025-06-30T23:50:51.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61002025-06-30T23:50:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61012025-06-30T23:50:51.087ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
61022025-06-30T23:50:51.087ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 58.3599ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
61032025-06-30T23:50:51.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.421679ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
61042025-06-30T23:50:51.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61052025-06-30T23:50:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61062025-06-30T23:50:51.090ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61072025-06-30T23:50:51.090ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61082025-06-30T23:50:51.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61092025-06-30T23:50:51.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61102025-06-30T23:50:51.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61112025-06-30T23:50:51.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61122025-06-30T23:50:51.093ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 56.892576ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
61132025-06-30T23:50:51.093ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61142025-06-30T23:50:51.093ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61152025-06-30T23:50:51.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61162025-06-30T23:50:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61172025-06-30T23:50:51.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61182025-06-30T23:50:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61192025-06-30T23:50:51.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61202025-06-30T23:50:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
61212025-06-30T23:50:51.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61222025-06-30T23:50:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61232025-06-30T23:50:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.964621ms iteration = 20 status = {"physical_disks_added":0}
61242025-06-30T23:50:51.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
61252025-06-30T23:50:51.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.149246ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
61262025-06-30T23:50:51.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.483662ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61272025-06-30T23:50:51.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282025-06-30T23:50:51.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
61292025-06-30T23:50:51.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61302025-06-30T23:50:51.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61312025-06-30T23:50:51.137ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.455319ms iteration = 18 status = 0
61322025-06-30T23:50:51.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61332025-06-30T23:50:51.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61342025-06-30T23:50:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.692402ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61352025-06-30T23:50:51.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
61362025-06-30T23:50:51.210ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61372025-06-30T23:50:51.211ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf8fd30-db1e-4ab2-97e8-69cc55d19196", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61382025-06-30T23:50:51.211ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61392025-06-30T23:50:51.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61402025-06-30T23:50:51.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61412025-06-30T23:50:51.212ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
61422025-06-30T23:50:51.236ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61432025-06-30T23:50:51.236ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61442025-06-30T23:50:51.236ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9853320-fb10-46fa-adbc-a1e8890d1d73", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61452025-06-30T23:50:51.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61462025-06-30T23:50:51.237ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61472025-06-30T23:50:51.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482025-06-30T23:50:51.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61492025-06-30T23:50:51.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61502025-06-30T23:50:51.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61512025-06-30T23:50:51.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61522025-06-30T23:50:51.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
61532025-06-30T23:50:51.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61542025-06-30T23:50:51.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61552025-06-30T23:50:51.284ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61562025-06-30T23:50:51.284ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61572025-06-30T23:50:51.284ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51d448b-cfa2-41b4-b0f6-6e15cd886722", "content-length": "372", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61582025-06-30T23:50:51.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61592025-06-30T23:50:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61602025-06-30T23:50:51.287ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61612025-06-30T23:50:51.287ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61622025-06-30T23:50:51.287ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce3d9b52-260c-42e7-b759-94d270dde219", "content-length": "26", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61632025-06-30T23:50:51.287ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61642025-06-30T23:50:51.289ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61652025-06-30T23:50:51.298ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61662025-06-30T23:50:51.298ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61672025-06-30T23:50:51.299ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "63baff5d-ccf5-4da9-bb71-c093100adc31", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61682025-06-30T23:50:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61692025-06-30T23:50:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61702025-06-30T23:50:51.300ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
61712025-06-30T23:50:51.300ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "393f558d-4231-4a97-a0dc-e204d4fa3d21", "content-length": "78", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61722025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
61732025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
61742025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
61752025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
61762025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
61772025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
61782025-06-30T23:50:51.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61792025-06-30T23:50:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61802025-06-30T23:50:51.303ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
61812025-06-30T23:50:51.303ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
61822025-06-30T23:50:51.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
61832025-06-30T23:50:51.304ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
61842025-06-30T23:50:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
61852025-06-30T23:50:51.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
61862025-06-30T23:50:51.305ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
61872025-06-30T23:50:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
61882025-06-30T23:50:51.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61892025-06-30T23:50:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61902025-06-30T23:50:51.309ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61912025-06-30T23:50:51.309ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61922025-06-30T23:50:51.309ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "674199d3-97c6-48c8-8a25-960cc7162310", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61932025-06-30T23:50:51.314ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.134383ms iteration = 18 status = {}
61942025-06-30T23:50:51.346ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
61952025-06-30T23:50:51.347ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
61962025-06-30T23:50:51.347ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
61972025-06-30T23:50:51.347ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "32534fba-9d64-437c-9f83-a099f5a8104b", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
61982025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
61992025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
62002025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
62012025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
62022025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
62032025-06-30T23:50:51.348ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bdfaa80-8f51-4f3c-a4c2-780c50554ec4", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
62042025-06-30T23:50:51.384ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
62052025-06-30T23:50:51.384ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
62062025-06-30T23:50:51.384ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b47cf54-4dc1-4159-b5ba-0c53c23f4d4e", "content-length": "81", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
62072025-06-30T23:50:51.385ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 347.152961ms iteration = 18 status = {"errors":[],"sps":[]}
62082025-06-30T23:50:51.387ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.006771ms iteration = 18 status = {}
62092025-06-30T23:50:51.396ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62102025-06-30T23:50:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62112025-06-30T23:50:51.397ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 371.291899ms iteration = 18 status = null
62122025-06-30T23:50:51.426ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62132025-06-30T23:50:51.427ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd1f1b19-e4a8-4911-80fe-eeb224342f67", "content-length": "691", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
62142025-06-30T23:50:51.427ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62152025-06-30T23:50:51.427ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62162025-06-30T23:50:51.427ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62172025-06-30T23:50:51.428ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.320388ms iteration = 18 status = {}
62182025-06-30T23:50:51.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62192025-06-30T23:50:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62202025-06-30T23:50:51.458ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
62212025-06-30T23:50:51.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62222025-06-30T23:50:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62232025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
62242025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
62252025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62262025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62272025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62282025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62292025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62302025-06-30T23:50:51.469ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62312025-06-30T23:50:51.470ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62322025-06-30T23:50:51.470ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62332025-06-30T23:50:51.470ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
62342025-06-30T23:50:51.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62352025-06-30T23:50:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62362025-06-30T23:50:51.473ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
62372025-06-30T23:50:51.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62382025-06-30T23:50:51.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e55e0393-9c60-4f7f-a04f-8a5ba6ac00ce roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62392025-06-30T23:50:51.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e55e0393-9c60-4f7f-a04f-8a5ba6ac00ce resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62402025-06-30T23:50:51.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e55e0393-9c60-4f7f-a04f-8a5ba6ac00ce response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62412025-06-30T23:50:51.578ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "efbd9ab1-f522-427c-8c8c-eca13e40d8c8", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
62422025-06-30T23:50:51.578ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
62432025-06-30T23:50:51.578ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62442025-06-30T23:50:51.579ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "77436c4c-4a0f-428a-b1a7-6d949b82a2b9", "content-length": "682", "date": "Mon, 30 Jun 2025 23:50:51 GMT"} })
62452025-06-30T23:50:51.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62462025-06-30T23:50:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62472025-06-30T23:50:51.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62482025-06-30T23:50:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62492025-06-30T23:50:51.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62502025-06-30T23:50:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62512025-06-30T23:50:51.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62522025-06-30T23:50:51.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62532025-06-30T23:50:51.594ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 565.876241ms iteration = 18 status = {}
62542025-06-30T23:50:51.904ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
62552025-06-30T23:50:51.904ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
62562025-06-30T23:50:51.961ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
62572025-06-30T23:50:51.961ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36717
62582025-06-30T23:50:51.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36717 req_id = 524e725d-1599-4325-95fd-3bd0f412d0ca roles = RoleSet { roles: {} } uri = /metrics/producers
62592025-06-30T23:50:51.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36717 req_id = 524e725d-1599-4325-95fd-3bd0f412d0ca resource = Database result = Ok(()) uri = /metrics/producers
62602025-06-30T23:50:52.018ZINFOnexus: assigned collector to new producer collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 file = nexus/src/app/oximeter.rs:76 producer_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
62612025-06-30T23:50:52.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 57146 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36717 req_id = 524e725d-1599-4325-95fd-3bd0f412d0ca response_code = 201 uri = /metrics/producers
62622025-06-30T23:50:52.018ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "524e725d-1599-4325-95fd-3bd0f412d0ca", "content-length": "41", "date": "Mon, 30 Jun 2025 23:50:52 GMT"} })
62632025-06-30T23:50:52.020ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
62642025-06-30T23:50:52.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7956e467-1316-4cc2-a92a-f8b9d7a22373 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62652025-06-30T23:50:52.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7956e467-1316-4cc2-a92a-f8b9d7a22373 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62662025-06-30T23:50:52.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7956e467-1316-4cc2-a92a-f8b9d7a22373 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62672025-06-30T23:50:53.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bac977ce-4521-44a9-a596-243846a33f9e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62682025-06-30T23:50:53.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bac977ce-4521-44a9-a596-243846a33f9e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62692025-06-30T23:50:53.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bac977ce-4521-44a9-a596-243846a33f9e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62702025-06-30T23:50:54.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 4fedb021-788d-4e15-b966-7a12d9d2290d response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
62712025-06-30T23:50:54.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b78fd68-5de3-4ca9-becb-2b845d790dde roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62722025-06-30T23:50:54.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b78fd68-5de3-4ca9-becb-2b845d790dde resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62732025-06-30T23:50:54.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6b78fd68-5de3-4ca9-becb-2b845d790dde response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62742025-06-30T23:50:55.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b3c3140-5df4-4b01-9286-22d705ddefbf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62752025-06-30T23:50:55.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b3c3140-5df4-4b01-9286-22d705ddefbf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62762025-06-30T23:50:55.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b3c3140-5df4-4b01-9286-22d705ddefbf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62772025-06-30T23:50:56.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f3f511-08f8-4431-aacc-2eee27c0178e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62782025-06-30T23:50:56.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f3f511-08f8-4431-aacc-2eee27c0178e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62792025-06-30T23:50:56.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f9f3f511-08f8-4431-aacc-2eee27c0178e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62802025-06-30T23:50:57.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 570047c3-fe87-4532-ba88-66b1bd37fbd9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62812025-06-30T23:50:57.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 570047c3-fe87-4532-ba88-66b1bd37fbd9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62822025-06-30T23:50:57.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 570047c3-fe87-4532-ba88-66b1bd37fbd9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62832025-06-30T23:50:58.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2b403c4-6734-4026-870c-c47a3b2df321 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62842025-06-30T23:50:58.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2b403c4-6734-4026-870c-c47a3b2df321 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62852025-06-30T23:50:58.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2b403c4-6734-4026-870c-c47a3b2df321 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62862025-06-30T23:50:59.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac33039d-ce9b-4072-b718-26af0b5bf001 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62872025-06-30T23:50:59.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac33039d-ce9b-4072-b718-26af0b5bf001 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62882025-06-30T23:50:59.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ac33039d-ce9b-4072-b718-26af0b5bf001 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62892025-06-30T23:51:00.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb008bce-f03b-40da-9816-a41f944fd29f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62902025-06-30T23:51:00.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb008bce-f03b-40da-9816-a41f944fd29f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62912025-06-30T23:51:00.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fb008bce-f03b-40da-9816-a41f944fd29f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
62922025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
62932025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
62942025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62952025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62962025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62972025-06-30T23:51:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62982025-06-30T23:51:01.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992025-06-30T23:51:01.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63002025-06-30T23:51:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63012025-06-30T23:51:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63022025-06-30T23:51:01.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63032025-06-30T23:51:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63042025-06-30T23:51:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63052025-06-30T23:51:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63062025-06-30T23:51:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63072025-06-30T23:51:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
63082025-06-30T23:51:01.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63092025-06-30T23:51:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63102025-06-30T23:51:01.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
63112025-06-30T23:51:01.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.9334ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
63122025-06-30T23:51:01.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.823389ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63132025-06-30T23:51:01.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf54f44-22cc-4fe4-803e-8f71d9488bda roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63142025-06-30T23:51:01.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf54f44-22cc-4fe4-803e-8f71d9488bda resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63152025-06-30T23:51:01.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cf54f44-22cc-4fe4-803e-8f71d9488bda response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63162025-06-30T23:51:02.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 807013a3-e4f2-41da-8cd4-faee4e45f71a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63172025-06-30T23:51:02.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 807013a3-e4f2-41da-8cd4-faee4e45f71a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63182025-06-30T23:51:02.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 807013a3-e4f2-41da-8cd4-faee4e45f71a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63192025-06-30T23:51:03.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 19f5ebbf-980c-4bdb-bec0-c9b6ec3cb6e5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63202025-06-30T23:51:03.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 19f5ebbf-980c-4bdb-bec0-c9b6ec3cb6e5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63212025-06-30T23:51:03.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 19f5ebbf-980c-4bdb-bec0-c9b6ec3cb6e5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63222025-06-30T23:51:04.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 520 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 9dfd8898-e657-4c51-84e0-e6516fd2d638 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
63232025-06-30T23:51:04.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9e97428-8e85-4505-ba37-50ddf5e9a6bf roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63242025-06-30T23:51:04.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9e97428-8e85-4505-ba37-50ddf5e9a6bf resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63252025-06-30T23:51:04.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9e97428-8e85-4505-ba37-50ddf5e9a6bf response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63262025-06-30T23:51:05.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 84682a20-37ea-4751-ae5d-ad3592fe5016 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63272025-06-30T23:51:05.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 84682a20-37ea-4751-ae5d-ad3592fe5016 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63282025-06-30T23:51:05.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 84682a20-37ea-4751-ae5d-ad3592fe5016 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63292025-06-30T23:51:06.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 042ee3d7-3a3a-4700-bda8-753a501422f4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63302025-06-30T23:51:06.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 042ee3d7-3a3a-4700-bda8-753a501422f4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63312025-06-30T23:51:06.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 042ee3d7-3a3a-4700-bda8-753a501422f4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63322025-06-30T23:51:07.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9cd821f1-b7d8-427e-b1d5-fa9dc85e1da9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63332025-06-30T23:51:07.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9cd821f1-b7d8-427e-b1d5-fa9dc85e1da9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63342025-06-30T23:51:07.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9cd821f1-b7d8-427e-b1d5-fa9dc85e1da9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63352025-06-30T23:51:08.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ada90b2-d4ef-4a25-b5e5-32d4774bf4b1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63362025-06-30T23:51:08.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ada90b2-d4ef-4a25-b5e5-32d4774bf4b1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63372025-06-30T23:51:08.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5ada90b2-d4ef-4a25-b5e5-32d4774bf4b1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63382025-06-30T23:51:09.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4267244-664b-470d-9f25-8679b9a92c16 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63392025-06-30T23:51:09.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4267244-664b-470d-9f25-8679b9a92c16 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63402025-06-30T23:51:09.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e4267244-664b-470d-9f25-8679b9a92c16 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63412025-06-30T23:51:10.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34977482-2a8e-4fdc-9708-78f1d2f4d94f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63422025-06-30T23:51:10.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34977482-2a8e-4fdc-9708-78f1d2f4d94f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63432025-06-30T23:51:10.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34977482-2a8e-4fdc-9708-78f1d2f4d94f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63442025-06-30T23:51:11.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
63452025-06-30T23:51:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
63462025-06-30T23:51:11.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63472025-06-30T23:51:11.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63482025-06-30T23:51:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63492025-06-30T23:51:11.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63502025-06-30T23:51:11.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63512025-06-30T23:51:11.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63522025-06-30T23:51:11.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63532025-06-30T23:51:11.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.158146ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63542025-06-30T23:51:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63552025-06-30T23:51:11.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63562025-06-30T23:51:11.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63572025-06-30T23:51:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63582025-06-30T23:51:11.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63592025-06-30T23:51:11.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63602025-06-30T23:51:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
63612025-06-30T23:51:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63622025-06-30T23:51:11.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63632025-06-30T23:51:11.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
63642025-06-30T23:51:11.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.418125ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
63652025-06-30T23:51:11.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c809f378-cabf-4bbc-a8eb-f051844b4ff2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63662025-06-30T23:51:11.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c809f378-cabf-4bbc-a8eb-f051844b4ff2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63672025-06-30T23:51:11.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c809f378-cabf-4bbc-a8eb-f051844b4ff2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63682025-06-30T23:51:12.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef6793af-cb49-4e5c-91b7-eaeb3e1d1434 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63692025-06-30T23:51:12.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef6793af-cb49-4e5c-91b7-eaeb3e1d1434 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63702025-06-30T23:51:12.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ef6793af-cb49-4e5c-91b7-eaeb3e1d1434 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63712025-06-30T23:51:13.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f36cbd7-1e6e-4440-8b5b-62380246fd51 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63722025-06-30T23:51:13.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f36cbd7-1e6e-4440-8b5b-62380246fd51 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63732025-06-30T23:51:13.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f36cbd7-1e6e-4440-8b5b-62380246fd51 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63742025-06-30T23:51:14.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 666 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = e7a9189b-aa8e-4851-aefe-001d642ed6d6 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
63752025-06-30T23:51:14.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8c6250a5-b8ab-46ac-b496-9d9481459e54 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63762025-06-30T23:51:14.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8c6250a5-b8ab-46ac-b496-9d9481459e54 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63772025-06-30T23:51:14.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8c6250a5-b8ab-46ac-b496-9d9481459e54 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63782025-06-30T23:51:15.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad515566-c304-4ab6-9ed0-77dbb8d551c1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63792025-06-30T23:51:15.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad515566-c304-4ab6-9ed0-77dbb8d551c1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63802025-06-30T23:51:15.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad515566-c304-4ab6-9ed0-77dbb8d551c1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63812025-06-30T23:51:16.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f2093fb-c080-4faf-af62-504d23d50166 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63822025-06-30T23:51:16.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f2093fb-c080-4faf-af62-504d23d50166 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63832025-06-30T23:51:16.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1f2093fb-c080-4faf-af62-504d23d50166 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63842025-06-30T23:51:17.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4ca8f441-3b16-45b4-87b8-af12d32a79be roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63852025-06-30T23:51:17.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4ca8f441-3b16-45b4-87b8-af12d32a79be resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63862025-06-30T23:51:17.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4ca8f441-3b16-45b4-87b8-af12d32a79be response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63872025-06-30T23:51:19.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5598b76f-e4b1-4ff7-8e16-e50a44fb9b18 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63882025-06-30T23:51:19.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5598b76f-e4b1-4ff7-8e16-e50a44fb9b18 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63892025-06-30T23:51:19.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5598b76f-e4b1-4ff7-8e16-e50a44fb9b18 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63902025-06-30T23:51:20.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5461d5fe-dd50-43a3-a27f-03e488470639 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63912025-06-30T23:51:20.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5461d5fe-dd50-43a3-a27f-03e488470639 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63922025-06-30T23:51:20.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5461d5fe-dd50-43a3-a27f-03e488470639 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
63932025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
63942025-06-30T23:51:21.026ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
63952025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.761\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
63962025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
63972025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
63982025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
63992025-06-30T23:51:21.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:41:21.026659361 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64002025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64012025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
64022025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64032025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64042025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64052025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
64062025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64072025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64082025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
64092025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
64102025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
64112025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64122025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
64132025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
64142025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64152025-06-30T23:51:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
64162025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64172025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
64182025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64192025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64202025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64212025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64222025-06-30T23:51:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 663188774 } })
64232025-06-30T23:51:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 663212344 } })
64242025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
64252025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.079745ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
64262025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
64272025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.041984ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
64282025-06-30T23:51:21.027ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
64292025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64302025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
64312025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64322025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64332025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
64342025-06-30T23:51:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
64352025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 13 reason = Timeout
64362025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64372025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
64382025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
64392025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 7.23\u{b5}s iteration = 13 status = "Disabled"
64402025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
64412025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64422025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64432025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
64442025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
64452025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64462025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64472025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
64482025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64492025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
64502025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64512025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
64522025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64532025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64542025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64552025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64562025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64572025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64582025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64592025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64602025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64612025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64622025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64632025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64642025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64652025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64662025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64672025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64682025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64692025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64702025-06-30T23:51:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64712025-06-30T23:51:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64722025-06-30T23:51:21.030ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:41:21.026659361 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64732025-06-30T23:51:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.372428ms iteration = 10 status = {"expiration":"2025-06-30T23:41:21.026659361Z","pruned":[]}
64742025-06-30T23:51:21.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64752025-06-30T23:51:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.584432ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64762025-06-30T23:51:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64772025-06-30T23:51:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64782025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64792025-06-30T23:51:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 668041936 } })
64802025-06-30T23:51:21.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 668110828 } })
64812025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64822025-06-30T23:51:21.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
64832025-06-30T23:51:21.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
64842025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64852025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64862025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64872025-06-30T23:51:21.032ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64882025-06-30T23:51:21.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892025-06-30T23:51:21.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902025-06-30T23:51:21.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64912025-06-30T23:51:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64922025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64942025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64952025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64962025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
64972025-06-30T23:51:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
64982025-06-30T23:51:21.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a0ddfe8e-0ef2-417a-baaa-2bdd440a0930 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
64992025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65002025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65012025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
65022025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65032025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
65042025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65052025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
65062025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65072025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
65082025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
65092025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
65102025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
65112025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
65122025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65132025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
65142025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65152025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65162025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
65172025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
65182025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
65192025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65202025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
65212025-06-30T23:51:21.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65222025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65232025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
65242025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65252025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65262025-06-30T23:51:21.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a0ddfe8e-0ef2-417a-baaa-2bdd440a0930 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
65272025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65282025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65292025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65302025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65312025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65322025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65332025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
65342025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
65352025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65362025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65372025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
65382025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65392025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65402025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65412025-06-30T23:51:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65422025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65432025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65442025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65452025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65462025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65472025-06-30T23:51:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65482025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65492025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
65502025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65512025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65522025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65532025-06-30T23:51:21.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 674455084 } })
65542025-06-30T23:51:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65552025-06-30T23:51:21.039ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65562025-06-30T23:51:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65572025-06-30T23:51:21.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65582025-06-30T23:51:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65592025-06-30T23:51:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65602025-06-30T23:51:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65612025-06-30T23:51:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65622025-06-30T23:51:21.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65632025-06-30T23:51:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65642025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
65652025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
65662025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
65672025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65682025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65692025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65702025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65712025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65722025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65742025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65752025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65762025-06-30T23:51:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65772025-06-30T23:51:21.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a0ddfe8e-0ef2-417a-baaa-2bdd440a0930 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
65782025-06-30T23:51:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.545405ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
65792025-06-30T23:51:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65802025-06-30T23:51:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65812025-06-30T23:51:21.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65822025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65832025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65842025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.228393ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
65852025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65862025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65872025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65882025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65892025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65902025-06-30T23:51:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65912025-06-30T23:51:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65922025-06-30T23:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932025-06-30T23:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65942025-06-30T23:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65952025-06-30T23:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65962025-06-30T23:51:21.047ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
65972025-06-30T23:51:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 11.701741ms iteration = 10 status = {"by_rx":{},"error":null}
65982025-06-30T23:51:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992025-06-30T23:51:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66002025-06-30T23:51:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66012025-06-30T23:51:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66022025-06-30T23:51:21.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66032025-06-30T23:51:21.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66042025-06-30T23:51:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66052025-06-30T23:51:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 687827733 } })
66062025-06-30T23:51:21.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66072025-06-30T23:51:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66082025-06-30T23:51:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66092025-06-30T23:51:21.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
66102025-06-30T23:51:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66112025-06-30T23:51:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66122025-06-30T23:51:21.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132025-06-30T23:51:21.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66142025-06-30T23:51:21.055ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
66152025-06-30T23:51:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 19.741007ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
66162025-06-30T23:51:21.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172025-06-30T23:51:21.056ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
66182025-06-30T23:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
66192025-06-30T23:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66202025-06-30T23:51:21.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66212025-06-30T23:51:21.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66222025-06-30T23:51:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66232025-06-30T23:51:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66242025-06-30T23:51:21.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66252025-06-30T23:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66262025-06-30T23:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66272025-06-30T23:51:21.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66282025-06-30T23:51:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.229627ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
66292025-06-30T23:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66302025-06-30T23:51:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66312025-06-30T23:51:21.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66322025-06-30T23:51:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
66332025-06-30T23:51:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66342025-06-30T23:51:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66352025-06-30T23:51:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66362025-06-30T23:51:21.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66372025-06-30T23:51:21.078ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66382025-06-30T23:51:21.078ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
66392025-06-30T23:51:21.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66402025-06-30T23:51:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66412025-06-30T23:51:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66422025-06-30T23:51:21.079ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66432025-06-30T23:51:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66442025-06-30T23:51:21.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66452025-06-30T23:51:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66462025-06-30T23:51:21.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66472025-06-30T23:51:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 60.322175ms iteration = 5 status = {"nsuccess":5}
66482025-06-30T23:51:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66492025-06-30T23:51:21.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66502025-06-30T23:51:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66512025-06-30T23:51:21.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.22713ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66522025-06-30T23:51:21.090ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66532025-06-30T23:51:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66542025-06-30T23:51:21.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.273069ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
66552025-06-30T23:51:21.093ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66562025-06-30T23:51:21.093ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66572025-06-30T23:51:21.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.985387ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66582025-06-30T23:51:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66592025-06-30T23:51:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66602025-06-30T23:51:21.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66612025-06-30T23:51:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66622025-06-30T23:51:21.095ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
66632025-06-30T23:51:21.095ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66642025-06-30T23:51:21.095ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
66652025-06-30T23:51:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 69.164ms iteration = 10 status = {"generation":2}
66662025-06-30T23:51:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.906846ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66672025-06-30T23:51:21.096ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 60.157572ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
66682025-06-30T23:51:21.097ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66692025-06-30T23:51:21.097ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
66702025-06-30T23:51:21.097ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.939105ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66712025-06-30T23:51:21.097ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66722025-06-30T23:51:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66732025-06-30T23:51:21.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66742025-06-30T23:51:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66752025-06-30T23:51:21.104ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66762025-06-30T23:51:21.104ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66772025-06-30T23:51:21.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66782025-06-30T23:51:21.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
66792025-06-30T23:51:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.92163ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
66802025-06-30T23:51:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66812025-06-30T23:51:21.105ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
66822025-06-30T23:51:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 77.193126ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66832025-06-30T23:51:21.107ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66842025-06-30T23:51:21.107ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66852025-06-30T23:51:21.107ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.226968ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66862025-06-30T23:51:21.107ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66872025-06-30T23:51:21.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66882025-06-30T23:51:21.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66892025-06-30T23:51:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66902025-06-30T23:51:21.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912025-06-30T23:51:21.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66922025-06-30T23:51:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66932025-06-30T23:51:21.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66942025-06-30T23:51:21.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66952025-06-30T23:51:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66962025-06-30T23:51:21.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66972025-06-30T23:51:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66982025-06-30T23:51:21.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66992025-06-30T23:51:21.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002025-06-30T23:51:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67012025-06-30T23:51:21.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022025-06-30T23:51:21.116ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67032025-06-30T23:51:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.679086ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67042025-06-30T23:51:21.117ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67052025-06-30T23:51:21.117ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67062025-06-30T23:51:21.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67072025-06-30T23:51:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67082025-06-30T23:51:21.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67092025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67102025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67112025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67122025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
67132025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67142025-06-30T23:51:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67152025-06-30T23:51:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.314418ms iteration = 19 status = 0
67162025-06-30T23:51:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67172025-06-30T23:51:21.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67182025-06-30T23:51:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67192025-06-30T23:51:21.124ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
67202025-06-30T23:51:21.124ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67212025-06-30T23:51:21.124ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
67222025-06-30T23:51:21.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 97.404053ms iteration = 10 status = {"generation":1}
67232025-06-30T23:51:21.143ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67242025-06-30T23:51:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67252025-06-30T23:51:21.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.073053ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67262025-06-30T23:51:21.148ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67272025-06-30T23:51:21.148ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67282025-06-30T23:51:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.792759ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67292025-06-30T23:51:21.167ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
67302025-06-30T23:51:21.167ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 140.676674ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67312025-06-30T23:51:21.188ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.33287ms iteration = 21 status = {"physical_disks_added":0}
67322025-06-30T23:51:21.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67332025-06-30T23:51:21.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
67342025-06-30T23:51:21.218ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67352025-06-30T23:51:21.218ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2707eb-10a3-4bd9-9d5c-a20a43396830", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67362025-06-30T23:51:21.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67372025-06-30T23:51:21.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67382025-06-30T23:51:21.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67392025-06-30T23:51:21.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67402025-06-30T23:51:21.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67412025-06-30T23:51:21.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67422025-06-30T23:51:21.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67432025-06-30T23:51:21.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67442025-06-30T23:51:21.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67452025-06-30T23:51:21.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67462025-06-30T23:51:21.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67472025-06-30T23:51:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67482025-06-30T23:51:21.231ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
67492025-06-30T23:51:21.232ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67502025-06-30T23:51:21.232ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "045a14e1-cf50-4fb3-8d7f-64372c44ffea", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67512025-06-30T23:51:21.232ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67522025-06-30T23:51:21.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67532025-06-30T23:51:21.251ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
67542025-06-30T23:51:21.251ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67552025-06-30T23:51:21.251ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e571f555-2357-4569-8444-9278bbefeb94", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67562025-06-30T23:51:21.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67572025-06-30T23:51:21.253ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
67582025-06-30T23:51:21.358ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67592025-06-30T23:51:21.358ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67602025-06-30T23:51:21.358ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4bbb5ae-c975-471e-b0a7-d05894d24630", "content-length": "372", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67612025-06-30T23:51:21.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67622025-06-30T23:51:21.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67632025-06-30T23:51:21.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67642025-06-30T23:51:21.426ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67652025-06-30T23:51:21.426ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67662025-06-30T23:51:21.426ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "353762db-be25-49ff-9bac-9e281d307553", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67672025-06-30T23:51:21.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67682025-06-30T23:51:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67692025-06-30T23:51:21.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67702025-06-30T23:51:21.430ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
67712025-06-30T23:51:21.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67722025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "227e3320-10a8-4e1f-9bfb-2641501582c5", "content-length": "78", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67732025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
67742025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
67752025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
67762025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
67772025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
67782025-06-30T23:51:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
67792025-06-30T23:51:21.433ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
67802025-06-30T23:51:21.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67812025-06-30T23:51:21.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67822025-06-30T23:51:21.434ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
67832025-06-30T23:51:21.434ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
67842025-06-30T23:51:21.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
67852025-06-30T23:51:21.437ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
67862025-06-30T23:51:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
67872025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
67882025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
67892025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
67902025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
67912025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
67922025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
67932025-06-30T23:51:21.438ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67942025-06-30T23:51:21.438ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67952025-06-30T23:51:21.439ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4e50276e-38d1-4712-b72b-53c461fc8746", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
67962025-06-30T23:51:21.442ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.164405ms iteration = 19 status = {}
67972025-06-30T23:51:21.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67982025-06-30T23:51:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67992025-06-30T23:51:21.465ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 438.268699ms iteration = 19 status = null
68002025-06-30T23:51:21.476ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
68012025-06-30T23:51:21.476ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
68022025-06-30T23:51:21.477ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e74f939c-8a0f-4490-b436-1ca4d9ac6f41", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68032025-06-30T23:51:21.494ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
68042025-06-30T23:51:21.494ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
68052025-06-30T23:51:21.495ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "48868275-bd97-400b-b123-7af3f07137b8", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68062025-06-30T23:51:21.499ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
68072025-06-30T23:51:21.499ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
68082025-06-30T23:51:21.499ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e936b8ae-fc80-48e4-96c6-9dcb10fbfc0d", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68092025-06-30T23:51:21.501ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 463.692636ms iteration = 19 status = {"errors":[],"sps":[]}
68102025-06-30T23:51:21.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68112025-06-30T23:51:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 505.804901ms iteration = 19 status = {}
68122025-06-30T23:51:21.559ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68132025-06-30T23:51:21.560ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "33df051e-7e1a-4e35-aa20-e6714a71431a", "content-length": "691", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68142025-06-30T23:51:21.560ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68152025-06-30T23:51:21.560ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68162025-06-30T23:51:21.560ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68172025-06-30T23:51:21.563ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 535.223192ms iteration = 19 status = {}
68182025-06-30T23:51:21.584ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68192025-06-30T23:51:21.585ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a1633671-506c-4ce1-b021-3e122f7b0e2f", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68202025-06-30T23:51:21.585ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68212025-06-30T23:51:21.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2c0c3042-3b1a-4a89-86b1-3471abb3b3a6", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68222025-06-30T23:51:21.587ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68232025-06-30T23:51:21.589ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68242025-06-30T23:51:21.589ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 562.456832ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68252025-06-30T23:51:21.623ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68262025-06-30T23:51:21.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ae57b94b-7eac-4d69-9dd6-eaeac05ae35e", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68272025-06-30T23:51:21.624ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68282025-06-30T23:51:21.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2258fdf-92e2-41a1-be52-41ef0475c8e8", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68292025-06-30T23:51:21.626ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68302025-06-30T23:51:21.629ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2757a844-d21b-429a-92ac-e741e7c91e31", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68312025-06-30T23:51:21.629ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68322025-06-30T23:51:21.632ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
68332025-06-30T23:51:21.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 605.431696ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68342025-06-30T23:51:21.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68352025-06-30T23:51:21.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68362025-06-30T23:51:21.652ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
68372025-06-30T23:51:21.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68382025-06-30T23:51:21.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68392025-06-30T23:51:21.665ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
68402025-06-30T23:51:21.665ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
68412025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68422025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68432025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68442025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68452025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68462025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68472025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68482025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68492025-06-30T23:51:21.666ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
68502025-06-30T23:51:21.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68512025-06-30T23:51:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68522025-06-30T23:51:21.669ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
68532025-06-30T23:51:21.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68542025-06-30T23:51:21.775ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e871f1a3-16f3-4293-b3c0-de91c313ce10", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68552025-06-30T23:51:21.775ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
68562025-06-30T23:51:21.775ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68572025-06-30T23:51:21.775ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2ddf36a-f832-40bc-bd5b-6803bb411cfb", "content-length": "682", "date": "Mon, 30 Jun 2025 23:51:21 GMT"} })
68582025-06-30T23:51:21.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68592025-06-30T23:51:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68602025-06-30T23:51:21.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68612025-06-30T23:51:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68622025-06-30T23:51:21.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68632025-06-30T23:51:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68642025-06-30T23:51:21.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68652025-06-30T23:51:21.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68662025-06-30T23:51:21.793ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 765.592821ms iteration = 19 status = {}
68672025-06-30T23:51:22.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9618f9a6-46a5-465f-80eb-a5032808f3d3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68682025-06-30T23:51:22.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9618f9a6-46a5-465f-80eb-a5032808f3d3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68692025-06-30T23:51:22.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9618f9a6-46a5-465f-80eb-a5032808f3d3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68702025-06-30T23:51:23.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee684084-e6c3-4cb1-a322-fd137509a3bc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68712025-06-30T23:51:23.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee684084-e6c3-4cb1-a322-fd137509a3bc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68722025-06-30T23:51:23.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee684084-e6c3-4cb1-a322-fd137509a3bc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68732025-06-30T23:51:24.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b2e948f3-74ac-4951-82e0-1d22d2c60dda roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68742025-06-30T23:51:24.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b2e948f3-74ac-4951-82e0-1d22d2c60dda resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68752025-06-30T23:51:24.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b2e948f3-74ac-4951-82e0-1d22d2c60dda response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68762025-06-30T23:51:24.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 52677abf-da0f-4087-9a26-875c9c611057 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
68772025-06-30T23:51:25.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f78de170-2062-47a6-9942-abf2fc98fcfa roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68782025-06-30T23:51:25.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f78de170-2062-47a6-9942-abf2fc98fcfa resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68792025-06-30T23:51:25.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f78de170-2062-47a6-9942-abf2fc98fcfa response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68802025-06-30T23:51:26.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 21acd6f9-e55b-4365-b7d5-7997a488f16f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68812025-06-30T23:51:26.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 21acd6f9-e55b-4365-b7d5-7997a488f16f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68822025-06-30T23:51:26.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 21acd6f9-e55b-4365-b7d5-7997a488f16f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68832025-06-30T23:51:27.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9bab7132-ab09-4304-9e60-569c2caf6aa5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68842025-06-30T23:51:27.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9bab7132-ab09-4304-9e60-569c2caf6aa5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68852025-06-30T23:51:27.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9bab7132-ab09-4304-9e60-569c2caf6aa5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68862025-06-30T23:51:28.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 97534235-7c44-4d82-9599-083e12cac513 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68872025-06-30T23:51:28.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 97534235-7c44-4d82-9599-083e12cac513 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68882025-06-30T23:51:28.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 97534235-7c44-4d82-9599-083e12cac513 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68892025-06-30T23:51:29.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8ae4681b-a0d6-49de-b143-8aab1a77a975 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68902025-06-30T23:51:29.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8ae4681b-a0d6-49de-b143-8aab1a77a975 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68912025-06-30T23:51:29.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8ae4681b-a0d6-49de-b143-8aab1a77a975 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68922025-06-30T23:51:30.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddde0d90-7418-4d14-8976-6ee2b5b58eda roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68932025-06-30T23:51:30.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddde0d90-7418-4d14-8976-6ee2b5b58eda resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68942025-06-30T23:51:30.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddde0d90-7418-4d14-8976-6ee2b5b58eda response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
68952025-06-30T23:51:31.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
68962025-06-30T23:51:31.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68972025-06-30T23:51:31.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
68982025-06-30T23:51:31.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68992025-06-30T23:51:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69002025-06-30T23:51:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69012025-06-30T23:51:31.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69022025-06-30T23:51:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69032025-06-30T23:51:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69042025-06-30T23:51:31.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.525845ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69052025-06-30T23:51:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69062025-06-30T23:51:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69072025-06-30T23:51:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69082025-06-30T23:51:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69092025-06-30T23:51:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69102025-06-30T23:51:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69112025-06-30T23:51:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
69122025-06-30T23:51:31.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69132025-06-30T23:51:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69142025-06-30T23:51:31.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
69152025-06-30T23:51:31.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.93675ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
69162025-06-30T23:51:31.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6781421e-9ee5-49a7-8075-8c932d156ca4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69172025-06-30T23:51:31.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6781421e-9ee5-49a7-8075-8c932d156ca4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69182025-06-30T23:51:31.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6781421e-9ee5-49a7-8075-8c932d156ca4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69192025-06-30T23:51:32.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3cc9c6c-a2be-41fb-912c-c7a3060c5b49 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69202025-06-30T23:51:32.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3cc9c6c-a2be-41fb-912c-c7a3060c5b49 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69212025-06-30T23:51:32.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b3cc9c6c-a2be-41fb-912c-c7a3060c5b49 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69222025-06-30T23:51:33.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7cbf7c08-a7c6-4d3b-ade3-78087d472f67 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69232025-06-30T23:51:33.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7cbf7c08-a7c6-4d3b-ade3-78087d472f67 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69242025-06-30T23:51:33.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7cbf7c08-a7c6-4d3b-ade3-78087d472f67 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69252025-06-30T23:51:34.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e11e510b-78dd-461f-8891-829f2d853dac roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69262025-06-30T23:51:34.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e11e510b-78dd-461f-8891-829f2d853dac resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69272025-06-30T23:51:34.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e11e510b-78dd-461f-8891-829f2d853dac response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69282025-06-30T23:51:34.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = f7f5b999-76cb-45b8-b851-6de8ab427470 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
69292025-06-30T23:51:35.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca682252-66e5-427d-be99-c9a7ccc457a7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69302025-06-30T23:51:35.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca682252-66e5-427d-be99-c9a7ccc457a7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69312025-06-30T23:51:35.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ca682252-66e5-427d-be99-c9a7ccc457a7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69322025-06-30T23:51:36.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7f7363c-300b-41d6-a51d-f6c8dadd261a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69332025-06-30T23:51:36.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7f7363c-300b-41d6-a51d-f6c8dadd261a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69342025-06-30T23:51:36.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7f7363c-300b-41d6-a51d-f6c8dadd261a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69352025-06-30T23:51:37.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ea4f1dfb-a73c-47da-8205-8467a00699cc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69362025-06-30T23:51:37.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ea4f1dfb-a73c-47da-8205-8467a00699cc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69372025-06-30T23:51:37.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ea4f1dfb-a73c-47da-8205-8467a00699cc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69382025-06-30T23:51:38.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1489b1b9-d5fc-4a84-b2ac-e5b0c367037c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69392025-06-30T23:51:38.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1489b1b9-d5fc-4a84-b2ac-e5b0c367037c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69402025-06-30T23:51:38.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1489b1b9-d5fc-4a84-b2ac-e5b0c367037c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69412025-06-30T23:51:39.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a6d4aaa1-6043-4857-8a36-fac236bb6450 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69422025-06-30T23:51:39.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a6d4aaa1-6043-4857-8a36-fac236bb6450 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69432025-06-30T23:51:39.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a6d4aaa1-6043-4857-8a36-fac236bb6450 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69442025-06-30T23:51:40.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6039ac63-b407-49fb-9704-c49062a8d327 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69452025-06-30T23:51:40.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6039ac63-b407-49fb-9704-c49062a8d327 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69462025-06-30T23:51:40.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6039ac63-b407-49fb-9704-c49062a8d327 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69472025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
69482025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69492025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
69502025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69512025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69522025-06-30T23:51:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532025-06-30T23:51:41.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69542025-06-30T23:51:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69552025-06-30T23:51:41.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562025-06-30T23:51:41.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.361661ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69572025-06-30T23:51:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69582025-06-30T23:51:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69592025-06-30T23:51:41.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69602025-06-30T23:51:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69612025-06-30T23:51:41.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69622025-06-30T23:51:41.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632025-06-30T23:51:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
69642025-06-30T23:51:41.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69652025-06-30T23:51:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69662025-06-30T23:51:41.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
69672025-06-30T23:51:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.813638ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
69682025-06-30T23:51:41.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5da7d755-6693-46dd-9540-e8daedfd24da roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69692025-06-30T23:51:41.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5da7d755-6693-46dd-9540-e8daedfd24da resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69702025-06-30T23:51:41.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5da7d755-6693-46dd-9540-e8daedfd24da response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69712025-06-30T23:51:42.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 563e51f9-1ccc-4e73-8a1f-54b83ef696d1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69722025-06-30T23:51:42.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 563e51f9-1ccc-4e73-8a1f-54b83ef696d1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69732025-06-30T23:51:42.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 563e51f9-1ccc-4e73-8a1f-54b83ef696d1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69742025-06-30T23:51:43.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31f23d02-4c86-42f7-ab5d-2360080cb558 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69752025-06-30T23:51:43.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31f23d02-4c86-42f7-ab5d-2360080cb558 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69762025-06-30T23:51:43.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 31f23d02-4c86-42f7-ab5d-2360080cb558 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69772025-06-30T23:51:44.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 7db53c72-704c-428a-8ddd-217d2d892521 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
69782025-06-30T23:51:44.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab6defb-e04e-4d83-aaa9-8a1de249b419 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69792025-06-30T23:51:44.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab6defb-e04e-4d83-aaa9-8a1de249b419 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69802025-06-30T23:51:44.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab6defb-e04e-4d83-aaa9-8a1de249b419 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69812025-06-30T23:51:45.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3c7e1da-2d27-4529-a23d-edf6982fbee1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69822025-06-30T23:51:45.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3c7e1da-2d27-4529-a23d-edf6982fbee1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69832025-06-30T23:51:45.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f3c7e1da-2d27-4529-a23d-edf6982fbee1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69842025-06-30T23:51:46.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f50bb89-c2a3-40c7-9a67-c2f8711b80ba roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69852025-06-30T23:51:46.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f50bb89-c2a3-40c7-9a67-c2f8711b80ba resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69862025-06-30T23:51:46.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f50bb89-c2a3-40c7-9a67-c2f8711b80ba response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69872025-06-30T23:51:47.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c106c55-7b1c-4292-9815-8c24c7da162e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69882025-06-30T23:51:47.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c106c55-7b1c-4292-9815-8c24c7da162e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69892025-06-30T23:51:47.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c106c55-7b1c-4292-9815-8c24c7da162e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69902025-06-30T23:51:48.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b15855e-864f-438f-bdfb-7ea18c61cbbc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69912025-06-30T23:51:48.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b15855e-864f-438f-bdfb-7ea18c61cbbc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69922025-06-30T23:51:48.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7b15855e-864f-438f-bdfb-7ea18c61cbbc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
69932025-06-30T23:51:49.320ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:62520
69942025-06-30T23:51:49.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = a5f6cbbb-951e-4133-a359-dd225b098e18 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
69952025-06-30T23:51:49.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = a5f6cbbb-951e-4133-a359-dd225b098e18 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
69962025-06-30T23:51:49.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = a5f6cbbb-951e-4133-a359-dd225b098e18 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
69972025-06-30T23:51:49.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f1351615-855f-419f-a5c4-d531d474b691 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
69982025-06-30T23:51:49.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f1351615-855f-419f-a5c4-d531d474b691 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
69992025-06-30T23:51:49.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f1351615-855f-419f-a5c4-d531d474b691 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
70002025-06-30T23:51:49.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cb1f59d-9cb5-4ae7-88ac-71ad7c2d1c87 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70012025-06-30T23:51:49.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cb1f59d-9cb5-4ae7-88ac-71ad7c2d1c87 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70022025-06-30T23:51:49.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5cb1f59d-9cb5-4ae7-88ac-71ad7c2d1c87 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70032025-06-30T23:51:50.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ab7c21e-3bb7-4ab3-9340-3b1bbf1807d9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70042025-06-30T23:51:50.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ab7c21e-3bb7-4ab3-9340-3b1bbf1807d9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70052025-06-30T23:51:50.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7ab7c21e-3bb7-4ab3-9340-3b1bbf1807d9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
70062025-06-30T23:51:51.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
70072025-06-30T23:51:51.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
70082025-06-30T23:51:51.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
70092025-06-30T23:51:51.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70102025-06-30T23:51:51.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70112025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70122025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70132025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
70142025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
70152025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70162025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70172025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
70182025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
70192025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70202025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70212025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
70222025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
70232025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70242025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70252025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
70262025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70272025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
70282025-06-30T23:51:51.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70292025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70302025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70312025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70322025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70332025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70342025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70352025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70362025-06-30T23:51:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70372025-06-30T23:51:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 666427578 } })
70382025-06-30T23:51:51.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.745726ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70392025-06-30T23:51:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 666611253 } })
70402025-06-30T23:51:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
70412025-06-30T23:51:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
70422025-06-30T23:51:51.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70432025-06-30T23:51:51.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442025-06-30T23:51:51.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70452025-06-30T23:51:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70462025-06-30T23:51:51.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472025-06-30T23:51:51.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70482025-06-30T23:51:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70492025-06-30T23:51:51.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70502025-06-30T23:51:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70512025-06-30T23:51:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70522025-06-30T23:51:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70532025-06-30T23:51:51.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70542025-06-30T23:51:51.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70552025-06-30T23:51:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.168289ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70562025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
70572025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70582025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
70592025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70602025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
70612025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70622025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
70632025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70642025-06-30T23:51:51.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70652025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
70662025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70672025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70682025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
70692025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70702025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
70712025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
70722025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
70732025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70742025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70752025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70762025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70772025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70782025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70792025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
70802025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70812025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70822025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70832025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70842025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70852025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70862025-06-30T23:51:51.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70872025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70882025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70892025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70902025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70912025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70922025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.495165ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
70932025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70942025-06-30T23:51:51.037ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
70952025-06-30T23:51:51.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70962025-06-30T23:51:51.038ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 674417413 } })
70972025-06-30T23:51:51.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 674463664 } })
70982025-06-30T23:51:51.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
70992025-06-30T23:51:51.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.616651ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
71002025-06-30T23:51:51.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71012025-06-30T23:51:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71022025-06-30T23:51:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71032025-06-30T23:51:51.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71042025-06-30T23:51:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71052025-06-30T23:51:51.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71062025-06-30T23:51:51.040ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71072025-06-30T23:51:51.040ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71082025-06-30T23:51:51.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71092025-06-30T23:51:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71102025-06-30T23:51:51.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71122025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71132025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71142025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71152025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71162025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71172025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.463739ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
71182025-06-30T23:51:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71192025-06-30T23:51:51.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71202025-06-30T23:51:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71212025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
71222025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71232025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71242025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.414845ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71252025-06-30T23:51:51.044ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71262025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71272025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71282025-06-30T23:51:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71292025-06-30T23:51:51.046ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71302025-06-30T23:51:51.046ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.874092ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71312025-06-30T23:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71322025-06-30T23:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71332025-06-30T23:51:51.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71342025-06-30T23:51:51.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71352025-06-30T23:51:51.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71362025-06-30T23:51:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71372025-06-30T23:51:51.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382025-06-30T23:51:51.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71392025-06-30T23:51:51.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71402025-06-30T23:51:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71412025-06-30T23:51:51.057ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
71422025-06-30T23:51:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.070495ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
71432025-06-30T23:51:51.076ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71442025-06-30T23:51:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71452025-06-30T23:51:51.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.510678ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71462025-06-30T23:51:51.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71472025-06-30T23:51:51.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71482025-06-30T23:51:51.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71492025-06-30T23:51:51.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71502025-06-30T23:51:51.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71512025-06-30T23:51:51.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71522025-06-30T23:51:51.091ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71532025-06-30T23:51:51.091ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71542025-06-30T23:51:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.338621ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71552025-06-30T23:51:51.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71562025-06-30T23:51:51.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572025-06-30T23:51:51.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71582025-06-30T23:51:51.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71592025-06-30T23:51:51.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71602025-06-30T23:51:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71612025-06-30T23:51:51.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71622025-06-30T23:51:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71632025-06-30T23:51:51.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71642025-06-30T23:51:51.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 58.279648ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71652025-06-30T23:51:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71662025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
71672025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71682025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71692025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71702025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71712025-06-30T23:51:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71722025-06-30T23:51:51.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71732025-06-30T23:51:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.388696ms iteration = 20 status = 0
71742025-06-30T23:51:51.097ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
71752025-06-30T23:51:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 69.785584ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71762025-06-30T23:51:51.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71772025-06-30T23:51:51.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71782025-06-30T23:51:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71792025-06-30T23:51:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.623796ms iteration = 22 status = {"physical_disks_added":0}
71802025-06-30T23:51:51.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
71812025-06-30T23:51:51.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71822025-06-30T23:51:51.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb88097f-a4a7-4052-adb6-f0f74f6d723e", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
71832025-06-30T23:51:51.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71842025-06-30T23:51:51.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71852025-06-30T23:51:51.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
71862025-06-30T23:51:51.181ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71872025-06-30T23:51:51.182ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c46bcb4-6cc1-497d-b3a1-4c6a1d0695c4", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
71882025-06-30T23:51:51.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71892025-06-30T23:51:51.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
71902025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
71912025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e23d1a-ce50-46ab-b5be-f6eb5fa07e42", "content-length": "78", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
71922025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
71932025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
71942025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
71952025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
71962025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
71972025-06-30T23:51:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
71982025-06-30T23:51:51.193ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
71992025-06-30T23:51:51.194ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
72002025-06-30T23:51:51.194ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
72012025-06-30T23:51:51.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
72022025-06-30T23:51:51.195ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72032025-06-30T23:51:51.195ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
72042025-06-30T23:51:51.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
72052025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e0f211a-334f-41fd-bae2-065816bd6f66", "content-length": "691", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72062025-06-30T23:51:51.196ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72072025-06-30T23:51:51.196ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72082025-06-30T23:51:51.196ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72092025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
72102025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
72112025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
72122025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
72132025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
72142025-06-30T23:51:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
72152025-06-30T23:51:51.197ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 169.84315ms iteration = 20 status = {}
72162025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
72172025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
72182025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb41b4e3-1d99-4f69-a266-1a4f03ed229c", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72192025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
72202025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
72212025-06-30T23:51:51.198ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6abe530-a8f1-4331-a847-51806d152670", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72222025-06-30T23:51:51.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
72232025-06-30T23:51:51.205ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72242025-06-30T23:51:51.205ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2765d75b-d565-4f20-ab09-e42f5b145a29", "content-length": "26", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72252025-06-30T23:51:51.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72262025-06-30T23:51:51.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72272025-06-30T23:51:51.233ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
72282025-06-30T23:51:51.233ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
72292025-06-30T23:51:51.234ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "85edf945-43b8-4bc7-89bf-7b17dc35d8c1", "content-length": "81", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72302025-06-30T23:51:51.235ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 197.060169ms iteration = 20 status = {"errors":[],"sps":[]}
72312025-06-30T23:51:51.268ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72322025-06-30T23:51:51.268ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72332025-06-30T23:51:51.269ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f166d00-1ac8-4fad-a4dd-d26194b445b7", "content-length": "372", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72342025-06-30T23:51:51.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72352025-06-30T23:51:51.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72362025-06-30T23:51:51.276ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.622094ms iteration = 20 status = {}
72372025-06-30T23:51:51.283ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72382025-06-30T23:51:51.283ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72392025-06-30T23:51:51.283ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5270471f-ea3a-495d-b096-47422b9b26f8", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72402025-06-30T23:51:51.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72412025-06-30T23:51:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72422025-06-30T23:51:51.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72432025-06-30T23:51:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72442025-06-30T23:51:51.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72452025-06-30T23:51:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72462025-06-30T23:51:51.290ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72472025-06-30T23:51:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72482025-06-30T23:51:51.291ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72492025-06-30T23:51:51.291ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72502025-06-30T23:51:51.292ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3c8473dc-e70d-4594-b281-163f234257c0", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72512025-06-30T23:51:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.515833ms iteration = 20 status = null
72522025-06-30T23:51:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.06749ms iteration = 20 status = {}
72532025-06-30T23:51:51.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72542025-06-30T23:51:51.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72552025-06-30T23:51:51.347ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
72562025-06-30T23:51:51.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72572025-06-30T23:51:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72582025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
72592025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
72602025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72612025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72622025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72632025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72642025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72652025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72662025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72672025-06-30T23:51:51.360ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72682025-06-30T23:51:51.361ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
72692025-06-30T23:51:51.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72702025-06-30T23:51:51.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72712025-06-30T23:51:51.363ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
72722025-06-30T23:51:51.363ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72732025-06-30T23:51:51.461ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "19907a3e-b051-4694-a9e8-3d74898315b4", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72742025-06-30T23:51:51.461ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
72752025-06-30T23:51:51.461ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72762025-06-30T23:51:51.461ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4839dbb4-4e07-4b7d-96d5-05364109dbfb", "content-length": "682", "date": "Mon, 30 Jun 2025 23:51:51 GMT"} })
72772025-06-30T23:51:51.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72782025-06-30T23:51:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72792025-06-30T23:51:51.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72802025-06-30T23:51:51.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72812025-06-30T23:51:51.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72822025-06-30T23:51:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72832025-06-30T23:51:51.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72842025-06-30T23:51:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72852025-06-30T23:51:51.478ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 450.601474ms iteration = 20 status = {}
72862025-06-30T23:51:51.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b10b752a-6d34-4d58-9249-5f538bc01543 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72872025-06-30T23:51:51.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b10b752a-6d34-4d58-9249-5f538bc01543 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72882025-06-30T23:51:51.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b10b752a-6d34-4d58-9249-5f538bc01543 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72892025-06-30T23:51:52.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d0cf0673-661c-4ff2-a97e-51a241ff872b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72902025-06-30T23:51:52.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d0cf0673-661c-4ff2-a97e-51a241ff872b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72912025-06-30T23:51:52.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d0cf0673-661c-4ff2-a97e-51a241ff872b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72922025-06-30T23:51:53.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4838c3e0-561a-4653-bd50-0472bbee61fb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72932025-06-30T23:51:53.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4838c3e0-561a-4653-bd50-0472bbee61fb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72942025-06-30T23:51:53.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4838c3e0-561a-4653-bd50-0472bbee61fb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72952025-06-30T23:51:54.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 852878b0-8d97-42c8-8238-7b8f97acd309 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
72962025-06-30T23:51:54.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7f943e12-1cd2-4551-9ebb-f9dfb83833e6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72972025-06-30T23:51:54.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7f943e12-1cd2-4551-9ebb-f9dfb83833e6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72982025-06-30T23:51:54.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7f943e12-1cd2-4551-9ebb-f9dfb83833e6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
72992025-06-30T23:51:55.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab15bb3-f178-4f2f-8e7f-5021c208b531 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73002025-06-30T23:51:55.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab15bb3-f178-4f2f-8e7f-5021c208b531 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73012025-06-30T23:51:55.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = dab15bb3-f178-4f2f-8e7f-5021c208b531 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73022025-06-30T23:51:56.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 179b7795-6430-43c9-a501-7d008db5061d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73032025-06-30T23:51:56.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 179b7795-6430-43c9-a501-7d008db5061d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73042025-06-30T23:51:56.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 179b7795-6430-43c9-a501-7d008db5061d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73052025-06-30T23:51:57.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9855e76a-84e8-4324-bba9-e6a719de8504 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73062025-06-30T23:51:57.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9855e76a-84e8-4324-bba9-e6a719de8504 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73072025-06-30T23:51:57.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9855e76a-84e8-4324-bba9-e6a719de8504 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73082025-06-30T23:51:58.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf833700-2190-4688-9073-91cc12e0eb72 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73092025-06-30T23:51:58.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf833700-2190-4688-9073-91cc12e0eb72 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73102025-06-30T23:51:58.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cf833700-2190-4688-9073-91cc12e0eb72 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73112025-06-30T23:51:59.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 37081a58-eeda-42d7-8400-f3f6e043983b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73122025-06-30T23:51:59.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 37081a58-eeda-42d7-8400-f3f6e043983b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73132025-06-30T23:51:59.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 37081a58-eeda-42d7-8400-f3f6e043983b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73142025-06-30T23:52:00.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57f62cc6-d7d1-458b-81a1-73907d0c6b21 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73152025-06-30T23:52:00.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57f62cc6-d7d1-458b-81a1-73907d0c6b21 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73162025-06-30T23:52:00.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57f62cc6-d7d1-458b-81a1-73907d0c6b21 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73172025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
73182025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
73192025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73202025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73212025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73222025-06-30T23:52:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73232025-06-30T23:52:01.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73242025-06-30T23:52:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73252025-06-30T23:52:01.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73262025-06-30T23:52:01.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.983803ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73272025-06-30T23:52:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73282025-06-30T23:52:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73292025-06-30T23:52:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73302025-06-30T23:52:01.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73312025-06-30T23:52:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73322025-06-30T23:52:01.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332025-06-30T23:52:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
73342025-06-30T23:52:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73352025-06-30T23:52:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73362025-06-30T23:52:01.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
73372025-06-30T23:52:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.296852ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
73382025-06-30T23:52:01.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f98748ae-f4bc-43b2-9739-628a077b4715 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73392025-06-30T23:52:01.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f98748ae-f4bc-43b2-9739-628a077b4715 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73402025-06-30T23:52:01.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f98748ae-f4bc-43b2-9739-628a077b4715 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73412025-06-30T23:52:02.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ed1df873-ed5f-4322-a994-2d1b1a9a99f3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73422025-06-30T23:52:02.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ed1df873-ed5f-4322-a994-2d1b1a9a99f3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73432025-06-30T23:52:02.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ed1df873-ed5f-4322-a994-2d1b1a9a99f3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73442025-06-30T23:52:03.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 13ac3184-8490-48b8-a960-467d7a754c0b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73452025-06-30T23:52:03.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 13ac3184-8490-48b8-a960-467d7a754c0b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73462025-06-30T23:52:03.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 13ac3184-8490-48b8-a960-467d7a754c0b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73472025-06-30T23:52:04.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = fb26f011-cf52-4077-a6f3-1b9d08b97705 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
73482025-06-30T23:52:04.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc1728dc-663d-4b6a-aaa3-1a2489302ea2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73492025-06-30T23:52:04.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc1728dc-663d-4b6a-aaa3-1a2489302ea2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73502025-06-30T23:52:04.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cc1728dc-663d-4b6a-aaa3-1a2489302ea2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73512025-06-30T23:52:05.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = afb022c0-347b-4fd9-8182-d6b1d9246e4d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73522025-06-30T23:52:05.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = afb022c0-347b-4fd9-8182-d6b1d9246e4d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73532025-06-30T23:52:05.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = afb022c0-347b-4fd9-8182-d6b1d9246e4d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73542025-06-30T23:52:06.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6db347d8-e91f-4cf3-b19b-370d870441b9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73552025-06-30T23:52:06.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6db347d8-e91f-4cf3-b19b-370d870441b9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73562025-06-30T23:52:06.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6db347d8-e91f-4cf3-b19b-370d870441b9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73572025-06-30T23:52:07.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb772941-1790-4b35-833c-f8fbef835f70 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73582025-06-30T23:52:07.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb772941-1790-4b35-833c-f8fbef835f70 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73592025-06-30T23:52:07.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bb772941-1790-4b35-833c-f8fbef835f70 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73602025-06-30T23:52:08.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bf087bde-c76b-4500-9d93-234d04750574 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73612025-06-30T23:52:08.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bf087bde-c76b-4500-9d93-234d04750574 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73622025-06-30T23:52:08.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bf087bde-c76b-4500-9d93-234d04750574 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73632025-06-30T23:52:09.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45951937-32c0-4344-a75e-12d4a590b127 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73642025-06-30T23:52:09.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45951937-32c0-4344-a75e-12d4a590b127 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73652025-06-30T23:52:09.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45951937-32c0-4344-a75e-12d4a590b127 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73662025-06-30T23:52:10.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 688416cc-69c9-4fd9-ab3c-3840d9102dea roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73672025-06-30T23:52:10.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 688416cc-69c9-4fd9-ab3c-3840d9102dea resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73682025-06-30T23:52:10.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 688416cc-69c9-4fd9-ab3c-3840d9102dea response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73692025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
73702025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73712025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
73722025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73732025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73742025-06-30T23:52:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73752025-06-30T23:52:11.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73762025-06-30T23:52:11.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73772025-06-30T23:52:11.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73782025-06-30T23:52:11.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.42571ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73792025-06-30T23:52:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73802025-06-30T23:52:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73812025-06-30T23:52:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73822025-06-30T23:52:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73832025-06-30T23:52:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73842025-06-30T23:52:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73852025-06-30T23:52:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
73862025-06-30T23:52:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73872025-06-30T23:52:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73882025-06-30T23:52:11.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
73892025-06-30T23:52:11.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.450149ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
73902025-06-30T23:52:11.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4045791f-afcc-4766-86f1-87e0ad88efb1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73912025-06-30T23:52:11.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4045791f-afcc-4766-86f1-87e0ad88efb1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73922025-06-30T23:52:11.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4045791f-afcc-4766-86f1-87e0ad88efb1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73932025-06-30T23:52:12.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a130f63a-6881-4520-b6e3-dd619b3b50a1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73942025-06-30T23:52:12.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a130f63a-6881-4520-b6e3-dd619b3b50a1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73952025-06-30T23:52:12.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a130f63a-6881-4520-b6e3-dd619b3b50a1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73962025-06-30T23:52:13.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d62020c-e813-4bbb-b810-1b6f8f01f8b2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73972025-06-30T23:52:13.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d62020c-e813-4bbb-b810-1b6f8f01f8b2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73982025-06-30T23:52:13.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4d62020c-e813-4bbb-b810-1b6f8f01f8b2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
73992025-06-30T23:52:14.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = bd5651f4-16c0-4f86-8a3f-bea6d3bba284 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
74002025-06-30T23:52:14.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02570dd3-3db3-49c3-a19a-16413d3bc5c6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74012025-06-30T23:52:14.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02570dd3-3db3-49c3-a19a-16413d3bc5c6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74022025-06-30T23:52:14.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02570dd3-3db3-49c3-a19a-16413d3bc5c6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74032025-06-30T23:52:15.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32bf2ba3-7ade-4fb6-a7ce-6b746b2092e8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74042025-06-30T23:52:15.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32bf2ba3-7ade-4fb6-a7ce-6b746b2092e8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74052025-06-30T23:52:15.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32bf2ba3-7ade-4fb6-a7ce-6b746b2092e8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74062025-06-30T23:52:16.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 819fafd2-f8ff-4078-9586-fde5ed394bc1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74072025-06-30T23:52:16.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 819fafd2-f8ff-4078-9586-fde5ed394bc1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74082025-06-30T23:52:16.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 819fafd2-f8ff-4078-9586-fde5ed394bc1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74092025-06-30T23:52:17.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8cd545ce-0907-4bae-abfa-96d8c4a7b2e2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74102025-06-30T23:52:17.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8cd545ce-0907-4bae-abfa-96d8c4a7b2e2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74112025-06-30T23:52:17.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8cd545ce-0907-4bae-abfa-96d8c4a7b2e2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74122025-06-30T23:52:18.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d9d3fd6b-b168-4533-9ace-9b1596353412 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74132025-06-30T23:52:18.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d9d3fd6b-b168-4533-9ace-9b1596353412 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74142025-06-30T23:52:18.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d9d3fd6b-b168-4533-9ace-9b1596353412 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74152025-06-30T23:52:19.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = c4bd2f2d-76c8-4de0-9d03-20e778e52abc roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
74162025-06-30T23:52:19.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = c4bd2f2d-76c8-4de0-9d03-20e778e52abc resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
74172025-06-30T23:52:19.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = c4bd2f2d-76c8-4de0-9d03-20e778e52abc response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
74182025-06-30T23:52:19.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = 45dc1e5d-bc2c-4ea3-8ef6-7032e255912f roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
74192025-06-30T23:52:19.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = 45dc1e5d-bc2c-4ea3-8ef6-7032e255912f resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
74202025-06-30T23:52:19.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = 45dc1e5d-bc2c-4ea3-8ef6-7032e255912f response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
74212025-06-30T23:52:19.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e7bb0d7e-f424-4e0e-97c3-e6ec9705465f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74222025-06-30T23:52:19.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e7bb0d7e-f424-4e0e-97c3-e6ec9705465f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74232025-06-30T23:52:19.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e7bb0d7e-f424-4e0e-97c3-e6ec9705465f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74242025-06-30T23:52:21.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff6eff85-3d86-4c2b-81d3-e92086abc7c0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74252025-06-30T23:52:21.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff6eff85-3d86-4c2b-81d3-e92086abc7c0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74262025-06-30T23:52:21.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ff6eff85-3d86-4c2b-81d3-e92086abc7c0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
74272025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
74282025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
74292025-06-30T23:52:21.025ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
74302025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
74312025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.991\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
74322025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74332025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
74342025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74352025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
74362025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
74372025-06-30T23:52:21.025ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
74382025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
74392025-06-30T23:52:21.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:42:21.025933240 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74402025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74412025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74422025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
74432025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
74442025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
74452025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74462025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
74472025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74482025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74492025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74502025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74512025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74522025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74532025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74542025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74552025-06-30T23:52:21.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 662783124 } })
74562025-06-30T23:52:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74572025-06-30T23:52:21.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 662842505 } })
74582025-06-30T23:52:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
74592025-06-30T23:52:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.100366ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
74602025-06-30T23:52:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
74612025-06-30T23:52:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.186967ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
74622025-06-30T23:52:21.028ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:42:21.025933240 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
74632025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.206661ms iteration = 11 status = {"expiration":"2025-06-30T23:42:21.025933240Z","pruned":[]}
74642025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
74652025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
74662025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74672025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
74682025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
74692025-06-30T23:52:21.028ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
74702025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74712025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
74722025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74732025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74742025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74752025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
74762025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
74772025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74782025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74792025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
74802025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
74812025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74822025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
74832025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74842025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74852025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
74862025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
74872025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 14 reason = Timeout
74882025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
74892025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.33\u{b5}s iteration = 14 status = "Disabled"
74902025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
74912025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74922025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74932025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74942025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
74952025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74962025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74972025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74982025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74992025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75002025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75012025-06-30T23:52:21.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75022025-06-30T23:52:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75032025-06-30T23:52:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75042025-06-30T23:52:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75052025-06-30T23:52:21.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 665981598 } })
75062025-06-30T23:52:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75072025-06-30T23:52:21.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 666240684 } })
75082025-06-30T23:52:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
75092025-06-30T23:52:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
75102025-06-30T23:52:21.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.559435ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75112025-06-30T23:52:21.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75122025-06-30T23:52:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75132025-06-30T23:52:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75142025-06-30T23:52:21.031ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75152025-06-30T23:52:21.031ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75162025-06-30T23:52:21.031ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75172025-06-30T23:52:21.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75182025-06-30T23:52:21.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75192025-06-30T23:52:21.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75202025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75212025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
75222025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75232025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75242025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75252025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75262025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75272025-06-30T23:52:21.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75282025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75292025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75302025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75312025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75322025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75332025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75342025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
75352025-06-30T23:52:21.035ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
75362025-06-30T23:52:21.035ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
75372025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
75382025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
75392025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75402025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
75412025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
75422025-06-30T23:52:21.035ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
75432025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75442025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
75452025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75462025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
75472025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
75482025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
75492025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
75502025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
75512025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75522025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
75532025-06-30T23:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
75542025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
75552025-06-30T23:52:21.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75562025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75572025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
75582025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75592025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
75602025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
75612025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
75622025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75632025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
75642025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75652025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
75662025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75672025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75682025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
75692025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75702025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75712025-06-30T23:52:21.036ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
75722025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75732025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
75742025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
75752025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75762025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75772025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
75782025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75792025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75802025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75812025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75822025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75832025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75842025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
75852025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75862025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75872025-06-30T23:52:21.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.688832ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75882025-06-30T23:52:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75892025-06-30T23:52:21.037ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75902025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75912025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
75922025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
75932025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
75942025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75952025-06-30T23:52:21.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 674836153 } })
75962025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75972025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
75982025-06-30T23:52:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75992025-06-30T23:52:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76002025-06-30T23:52:21.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76012025-06-30T23:52:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76022025-06-30T23:52:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76032025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76042025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76052025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76062025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76072025-06-30T23:52:21.043ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
76082025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76092025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 8.081737ms iteration = 11 status = {"by_rx":{},"error":null}
76102025-06-30T23:52:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76112025-06-30T23:52:21.044ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(f714622c-7bb5-4f93-ba89-d7dc7606ae46, 0), (32904deb-ef48-429f-88d0-861f8711cc6d, 0), (a63deca6-327e-4c91-83de-d439464e12e8, 0), (0eea6b07-fff7-4ecc-9e1d-4a6ae7ed373a, 0)] collection_id = f714622c-7bb5-4f93-ba89-d7dc7606ae46
76122025-06-30T23:52:21.044ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76132025-06-30T23:52:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76142025-06-30T23:52:21.046ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152025-06-30T23:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162025-06-30T23:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76172025-06-30T23:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76182025-06-30T23:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
76192025-06-30T23:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
76202025-06-30T23:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76212025-06-30T23:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
76222025-06-30T23:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76232025-06-30T23:52:21.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76242025-06-30T23:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76252025-06-30T23:52:21.050ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76262025-06-30T23:52:21.050ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76272025-06-30T23:52:21.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76282025-06-30T23:52:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76292025-06-30T23:52:21.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76302025-06-30T23:52:21.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76312025-06-30T23:52:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76322025-06-30T23:52:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.911258ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
76332025-06-30T23:52:21.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76342025-06-30T23:52:21.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
76352025-06-30T23:52:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
76362025-06-30T23:52:21.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76372025-06-30T23:52:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76382025-06-30T23:52:21.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76392025-06-30T23:52:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76402025-06-30T23:52:21.054ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76412025-06-30T23:52:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76422025-06-30T23:52:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76432025-06-30T23:52:21.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76442025-06-30T23:52:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76452025-06-30T23:52:21.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76462025-06-30T23:52:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76472025-06-30T23:52:21.064ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
76482025-06-30T23:52:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
76492025-06-30T23:52:21.066ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76502025-06-30T23:52:21.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
76512025-06-30T23:52:21.069ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
76522025-06-30T23:52:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
76532025-06-30T23:52:21.082ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76542025-06-30T23:52:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76552025-06-30T23:52:21.084ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
76562025-06-30T23:52:21.084ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 48.468841ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
76572025-06-30T23:52:21.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.47005ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76582025-06-30T23:52:21.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76592025-06-30T23:52:21.087ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76602025-06-30T23:52:21.087ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76612025-06-30T23:52:21.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76622025-06-30T23:52:21.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76632025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76642025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76652025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76662025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76672025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76682025-06-30T23:52:21.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76692025-06-30T23:52:21.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76702025-06-30T23:52:21.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76712025-06-30T23:52:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76722025-06-30T23:52:21.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.33686ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
76732025-06-30T23:52:21.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742025-06-30T23:52:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76752025-06-30T23:52:21.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76762025-06-30T23:52:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76772025-06-30T23:52:21.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76782025-06-30T23:52:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76792025-06-30T23:52:21.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76802025-06-30T23:52:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76812025-06-30T23:52:21.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76822025-06-30T23:52:21.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76832025-06-30T23:52:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 59.369373ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
76842025-06-30T23:52:21.097ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76852025-06-30T23:52:21.097ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76862025-06-30T23:52:21.097ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.096257ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76872025-06-30T23:52:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
76882025-06-30T23:52:21.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76892025-06-30T23:52:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76902025-06-30T23:52:21.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76912025-06-30T23:52:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.857688ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
76922025-06-30T23:52:21.101ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76932025-06-30T23:52:21.101ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76942025-06-30T23:52:21.101ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76952025-06-30T23:52:21.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76962025-06-30T23:52:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76972025-06-30T23:52:21.103ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76982025-06-30T23:52:21.103ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
76992025-06-30T23:52:21.103ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.492476ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77002025-06-30T23:52:21.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77012025-06-30T23:52:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77022025-06-30T23:52:21.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77032025-06-30T23:52:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77042025-06-30T23:52:21.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77052025-06-30T23:52:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77062025-06-30T23:52:21.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072025-06-30T23:52:21.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 744019503 } })
77082025-06-30T23:52:21.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
77092025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77102025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77112025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77122025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77132025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77142025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77152025-06-30T23:52:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77162025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77172025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77182025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77192025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 75.606599ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
77202025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77212025-06-30T23:52:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77222025-06-30T23:52:21.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77232025-06-30T23:52:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77242025-06-30T23:52:21.113ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77252025-06-30T23:52:21.113ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77262025-06-30T23:52:21.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77272025-06-30T23:52:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77282025-06-30T23:52:21.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.202009ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77292025-06-30T23:52:21.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77302025-06-30T23:52:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77312025-06-30T23:52:21.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77322025-06-30T23:52:21.117ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77332025-06-30T23:52:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77342025-06-30T23:52:21.119ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77352025-06-30T23:52:21.119ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.500692ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77362025-06-30T23:52:21.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77372025-06-30T23:52:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77382025-06-30T23:52:21.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77392025-06-30T23:52:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77402025-06-30T23:52:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77412025-06-30T23:52:21.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77422025-06-30T23:52:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77432025-06-30T23:52:21.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
77442025-06-30T23:52:21.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.367294ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
77452025-06-30T23:52:21.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77472025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77482025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
77492025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77502025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
77512025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 98.403156ms iteration = 11 status = {"generation":1}
77522025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77532025-06-30T23:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77542025-06-30T23:52:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77552025-06-30T23:52:21.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77562025-06-30T23:52:21.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572025-06-30T23:52:21.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77582025-06-30T23:52:21.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77592025-06-30T23:52:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77602025-06-30T23:52:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
77612025-06-30T23:52:21.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77622025-06-30T23:52:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77632025-06-30T23:52:21.140ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.569564ms iteration = 21 status = 0
77642025-06-30T23:52:21.144ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77652025-06-30T23:52:21.144ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77662025-06-30T23:52:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.360107ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77672025-06-30T23:52:21.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77682025-06-30T23:52:21.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77692025-06-30T23:52:21.145ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
77702025-06-30T23:52:21.145ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 117.040078ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
77712025-06-30T23:52:21.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722025-06-30T23:52:21.148ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = f714622c-7bb5-4f93-ba89-d7dc7606ae46 file = nexus/db-queries/src/db/datastore/inventory.rs:1937 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmupdate_override_non_boot = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agents = 0 nsps = 2 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
77732025-06-30T23:52:21.148ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77742025-06-30T23:52:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77752025-06-30T23:52:21.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77762025-06-30T23:52:21.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77772025-06-30T23:52:21.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77782025-06-30T23:52:21.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77792025-06-30T23:52:21.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77802025-06-30T23:52:21.153ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77812025-06-30T23:52:21.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.288777ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77822025-06-30T23:52:21.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77832025-06-30T23:52:21.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77842025-06-30T23:52:21.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77852025-06-30T23:52:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77862025-06-30T23:52:21.157ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(32904deb-ef48-429f-88d0-861f8711cc6d, 0), (a63deca6-327e-4c91-83de-d439464e12e8, 0), (0eea6b07-fff7-4ecc-9e1d-4a6ae7ed373a, 0)]
77872025-06-30T23:52:21.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 793924908 } })
77882025-06-30T23:52:21.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77892025-06-30T23:52:21.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77902025-06-30T23:52:21.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77912025-06-30T23:52:21.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77922025-06-30T23:52:21.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
77932025-06-30T23:52:21.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
77942025-06-30T23:52:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
77952025-06-30T23:52:21.164ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77962025-06-30T23:52:21.164ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
77972025-06-30T23:52:21.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77982025-06-30T23:52:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77992025-06-30T23:52:21.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78002025-06-30T23:52:21.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78012025-06-30T23:52:21.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
78022025-06-30T23:52:21.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
78032025-06-30T23:52:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
78042025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78052025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78062025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78072025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78082025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78092025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78102025-06-30T23:52:21.170ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
78112025-06-30T23:52:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 142.561548ms iteration = 5 status = {"blueprint_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","inventory_collection_id":"0eea6b07-fff7-4ecc-9e1d-4a6ae7ed373a","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
78122025-06-30T23:52:21.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78132025-06-30T23:52:21.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78142025-06-30T23:52:21.172ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
78152025-06-30T23:52:21.172ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
78162025-06-30T23:52:21.172ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
78172025-06-30T23:52:21.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 146.421688ms iteration = 11 status = {"generation":2}
78182025-06-30T23:52:21.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78192025-06-30T23:52:21.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78202025-06-30T23:52:21.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78212025-06-30T23:52:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78222025-06-30T23:52:21.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78232025-06-30T23:52:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78242025-06-30T23:52:21.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
78252025-06-30T23:52:21.180ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78262025-06-30T23:52:21.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78272025-06-30T23:52:21.180ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f93a4fb8-9ba2-4883-aa4d-b5e39dec179b", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
78282025-06-30T23:52:21.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78292025-06-30T23:52:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78302025-06-30T23:52:21.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78312025-06-30T23:52:21.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78322025-06-30T23:52:21.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78332025-06-30T23:52:21.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78342025-06-30T23:52:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78352025-06-30T23:52:21.185ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
78362025-06-30T23:52:21.185ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 159.314526ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78372025-06-30T23:52:21.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78382025-06-30T23:52:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78392025-06-30T23:52:21.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78402025-06-30T23:52:21.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78412025-06-30T23:52:21.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78422025-06-30T23:52:21.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78432025-06-30T23:52:21.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78442025-06-30T23:52:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78452025-06-30T23:52:21.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78462025-06-30T23:52:21.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78472025-06-30T23:52:21.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78482025-06-30T23:52:21.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78492025-06-30T23:52:21.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78502025-06-30T23:52:21.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78512025-06-30T23:52:21.200ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78522025-06-30T23:52:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78532025-06-30T23:52:21.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78542025-06-30T23:52:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78552025-06-30T23:52:21.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78562025-06-30T23:52:21.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78572025-06-30T23:52:21.204ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
78582025-06-30T23:52:21.204ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 168.174951ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78592025-06-30T23:52:21.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78602025-06-30T23:52:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78612025-06-30T23:52:21.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78622025-06-30T23:52:21.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78632025-06-30T23:52:21.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642025-06-30T23:52:21.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
78652025-06-30T23:52:21.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78662025-06-30T23:52:21.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78672025-06-30T23:52:21.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78682025-06-30T23:52:21.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78692025-06-30T23:52:21.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78702025-06-30T23:52:21.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78712025-06-30T23:52:21.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78722025-06-30T23:52:21.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
78732025-06-30T23:52:21.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78742025-06-30T23:52:21.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78752025-06-30T23:52:21.225ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78762025-06-30T23:52:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78772025-06-30T23:52:21.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78782025-06-30T23:52:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78792025-06-30T23:52:21.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78802025-06-30T23:52:21.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78812025-06-30T23:52:21.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78822025-06-30T23:52:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78832025-06-30T23:52:21.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78842025-06-30T23:52:21.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78852025-06-30T23:52:21.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78862025-06-30T23:52:21.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78872025-06-30T23:52:21.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78882025-06-30T23:52:21.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78892025-06-30T23:52:21.236ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 208.653986ms iteration = 23 status = {"physical_disks_added":0}
78902025-06-30T23:52:21.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78912025-06-30T23:52:21.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
78922025-06-30T23:52:21.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78932025-06-30T23:52:21.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78942025-06-30T23:52:21.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78952025-06-30T23:52:21.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78962025-06-30T23:52:21.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78972025-06-30T23:52:21.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78982025-06-30T23:52:21.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78992025-06-30T23:52:21.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
79002025-06-30T23:52:21.248ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79012025-06-30T23:52:21.248ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a32e875-1688-416e-a771-c1645ceca7e7", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79022025-06-30T23:52:21.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79032025-06-30T23:52:21.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79042025-06-30T23:52:21.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
79052025-06-30T23:52:21.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79062025-06-30T23:52:21.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79072025-06-30T23:52:21.257ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4436a287-b8f8-4aea-ab6f-e8cb958cd3fc, kind: Service { id: a599b643-15d6-4e04-9a50-c190de356556 }, name: Name("external-dns-a599b643-15d6-4e04-9a50-c190de356556"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 81])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3cc6049-4e6b-43bb-a0b5-a817e5484933, kind: Service { id: f83c5502-8876-4c9e-ac59-0c25fb356a4f }, name: Name("external-dns-f83c5502-8876-4c9e-ac59-0c25fb356a4f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 131])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 20dc5a81-5e96-4549-bd13-7f99adcf22ee, kind: Service { id: e7a416d3-841c-4855-bc73-36f56b8a2e99 }, name: Name("nexus-e7a416d3-841c-4855-bc73-36f56b8a2e99"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 246281a8-ba14-470f-81a5-a7cd6e0cf9b3, kind: Service { id: 87bd9b06-0063-44af-ba8f-109417453f8b }, name: Name("nexus-87bd9b06-0063-44af-ba8f-109417453f8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f38fd14c-fd19-45ab-ad4d-5a4b8cbe13af, kind: Service { id: ed91cd92-bfaa-47ff-9159-b398e804895f }, name: Name("nexus-ed91cd92-bfaa-47ff-9159-b398e804895f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
79082025-06-30T23:52:21.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79092025-06-30T23:52:21.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79102025-06-30T23:52:21.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79112025-06-30T23:52:21.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
79122025-06-30T23:52:21.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79132025-06-30T23:52:21.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79142025-06-30T23:52:21.262ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
79152025-06-30T23:52:21.262ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4436a287-b8f8-4aea-ab6f-e8cb958cd3fc, kind: Service { id: a599b643-15d6-4e04-9a50-c190de356556 }, name: Name("external-dns-a599b643-15d6-4e04-9a50-c190de356556"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 81])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3cc6049-4e6b-43bb-a0b5-a817e5484933, kind: Service { id: f83c5502-8876-4c9e-ac59-0c25fb356a4f }, name: Name("external-dns-f83c5502-8876-4c9e-ac59-0c25fb356a4f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 131])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 20dc5a81-5e96-4549-bd13-7f99adcf22ee, kind: Service { id: e7a416d3-841c-4855-bc73-36f56b8a2e99 }, name: Name("nexus-e7a416d3-841c-4855-bc73-36f56b8a2e99"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 246281a8-ba14-470f-81a5-a7cd6e0cf9b3, kind: Service { id: 87bd9b06-0063-44af-ba8f-109417453f8b }, name: Name("nexus-87bd9b06-0063-44af-ba8f-109417453f8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f38fd14c-fd19-45ab-ad4d-5a4b8cbe13af, kind: Service { id: ed91cd92-bfaa-47ff-9159-b398e804895f }, name: Name("nexus-ed91cd92-bfaa-47ff-9159-b398e804895f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
79162025-06-30T23:52:21.262ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
79172025-06-30T23:52:21.270ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79182025-06-30T23:52:21.273ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
79192025-06-30T23:52:21.276ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "62cdeaf4-7b3f-4efb-ad21-a6c5436474f7", "content-length": "78", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79202025-06-30T23:52:21.276ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
79212025-06-30T23:52:21.276ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
79222025-06-30T23:52:21.276ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
79232025-06-30T23:52:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
79242025-06-30T23:52:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
79252025-06-30T23:52:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
79262025-06-30T23:52:21.279ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
79272025-06-30T23:52:21.279ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
79282025-06-30T23:52:21.279ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
79292025-06-30T23:52:21.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
79302025-06-30T23:52:21.281ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
79312025-06-30T23:52:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
79322025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
79332025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
79342025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
79352025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
79362025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
79372025-06-30T23:52:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
79382025-06-30T23:52:21.283ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
79392025-06-30T23:52:21.283ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
79402025-06-30T23:52:21.283ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7ae7a1f-f020-422d-9f3f-6dde6501a3d2", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79412025-06-30T23:52:21.284ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
79422025-06-30T23:52:21.284ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
79432025-06-30T23:52:21.284ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
79442025-06-30T23:52:21.284ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
79452025-06-30T23:52:21.285ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "b07d32a5-12d5-4377-b007-c79e6b1ccfca", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79462025-06-30T23:52:21.285ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "2748a99d-615c-4709-97aa-009c51459fe7", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79472025-06-30T23:52:21.287ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 248.858106ms iteration = 21 status = {"errors":[],"sps":[]}
79482025-06-30T23:52:21.325ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e3c378dc-191c-4b79-a618-85fa0e1457c7, time_created: 2025-06-30T23:42:26.766547Z, time_modified: 2025-06-30T23:42:26.766547Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
79492025-06-30T23:52:21.325ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
79502025-06-30T23:52:21.379ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79512025-06-30T23:52:21.380ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "302b03a9-6b33-442b-8e4c-42ee7c6d7db1", "content-length": "691", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79522025-06-30T23:52:21.380ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79532025-06-30T23:52:21.380ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79542025-06-30T23:52:21.380ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79552025-06-30T23:52:21.381ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.371915ms iteration = 21 status = {}
79562025-06-30T23:52:21.400ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
79572025-06-30T23:52:21.477ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
79582025-06-30T23:52:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
79592025-06-30T23:52:21.479ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79602025-06-30T23:52:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
79612025-06-30T23:52:21.481ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
79622025-06-30T23:52:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
79632025-06-30T23:52:21.483ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
79642025-06-30T23:52:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
79652025-06-30T23:52:21.485ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79662025-06-30T23:52:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
79672025-06-30T23:52:21.486ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
79682025-06-30T23:52:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
79692025-06-30T23:52:21.488ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
79702025-06-30T23:52:21.489ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "1dff39cf-5826-4ea0-8b20-a9acc4a1fc93", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79712025-06-30T23:52:21.489ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
79722025-06-30T23:52:21.489ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "ead0b787-7278-47dd-8259-786c0ae84d03", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79732025-06-30T23:52:21.489ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
79742025-06-30T23:52:21.490ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 454.469003ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:47:21.360899943Z"},{"operation":"list","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:47:21.366434691Z"},{"generation":1,"operation":"put_config","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:52:21.489146416Z"},{"operation":"list","target_sled":"e3c378dc-191c-4b79-a618-85fa0e1457c7","time":"2025-06-30T23:52:21.489375002Z"}]}
79752025-06-30T23:52:21.517ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
79762025-06-30T23:52:21.517ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79772025-06-30T23:52:21.517ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "919d46d8-92d7-4140-ada2-e8436c3515e2", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79782025-06-30T23:52:21.517ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79792025-06-30T23:52:21.519ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
79802025-06-30T23:52:21.519ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
79812025-06-30T23:52:21.519ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
79822025-06-30T23:52:21.519ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
79832025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "90ad4d2c-cf1a-49b9-8563-afc0e2479ec1", "content-length": "476", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79842025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
79852025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27502de7-9ab3-4127-afb4-6224d1e0f398", "content-length": "734", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79862025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
79872025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ba6cc1-056c-4364-a054-9fc6be2fd87b", "content-length": "111", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79882025-06-30T23:52:21.520ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
79892025-06-30T23:52:21.521ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "55a17b44-94d0-4727-882b-4412d0e3cbd8", "content-length": "111", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79902025-06-30T23:52:21.521ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
79912025-06-30T23:52:21.521ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ffd15b-8577-44f7-8b9d-1dc7f7f3d54f", "content-length": "170", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79922025-06-30T23:52:21.521ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
79932025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe94e10b-fa66-4405-a586-392209881c11", "content-length": "170", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79942025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
79952025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d5ba481-8094-4abd-9cdf-2aaca5ec48b4", "content-length": "179", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79962025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
79972025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6acc6d98-95be-4ad0-a93c-ce710da90a09", "content-length": "179", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
79982025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
79992025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7d76f3f-b24a-43c8-a5d6-e2c5319aaf68", "content-length": "702", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80002025-06-30T23:52:21.522ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
80012025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f11f108-1ec8-4659-b9c3-8e08d79615ca", "content-length": "727", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80022025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
80032025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e86b30d1-4029-45ba-8cbb-fc01b064b5de", "content-length": "729", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80042025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
80052025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "feee3245-f2dd-4163-89da-4168c0bde880", "content-length": "728", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80062025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
80072025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "605415f6-c491-4d86-847a-254a3d01d564", "content-length": "722", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80082025-06-30T23:52:21.523ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
80092025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "95cb5c01-7b93-45f9-86a8-e276bdd67666", "content-length": "109", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80102025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
80112025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "68abf67c-1b5a-4bb5-9e2f-9d5123a990a7", "content-length": "109", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80122025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
80132025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "653467ba-2b52-4515-948c-f3fda04a6534", "content-length": "169", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80142025-06-30T23:52:21.524ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
80152025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "63c036c8-186a-40d0-8a05-56c92cf8b1ad", "content-length": "169", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80162025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
80172025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9483e088-01be-4347-ba69-fd96cf9c04a8", "content-length": "178", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80182025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
80192025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed7d7ca-75df-4ad5-b2b9-8bd5e344b62c", "content-length": "178", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80202025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
80212025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06542e84-1de5-45c3-bcc8-41281727919e", "content-length": "702", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80222025-06-30T23:52:21.525ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
80232025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8705c264-a7e7-44d8-9729-682150c4cb1c", "content-length": "727", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80242025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
80252025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7584e8a-c3a4-4095-af97-b9931be9e5b8", "content-length": "729", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80262025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
80272025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "00222011-a53f-400f-8a6e-207aabad3d1f", "content-length": "728", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80282025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80292025-06-30T23:52:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80302025-06-30T23:52:21.528ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312025-06-30T23:52:21.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
80322025-06-30T23:52:21.529ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80332025-06-30T23:52:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80342025-06-30T23:52:21.531ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80352025-06-30T23:52:21.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
80362025-06-30T23:52:21.533ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80372025-06-30T23:52:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80382025-06-30T23:52:21.554ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80392025-06-30T23:52:21.554ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80402025-06-30T23:52:21.554ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed1373f-d0ed-48a6-bea2-24b8628e77ee", "content-length": "372", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80412025-06-30T23:52:21.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80422025-06-30T23:52:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80432025-06-30T23:52:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 533.818349ms iteration = 21 status = {}
80442025-06-30T23:52:21.568ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80452025-06-30T23:52:21.568ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80462025-06-30T23:52:21.568ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f3467d9-9f42-4f2b-8537-e3fbde3b4e4c", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80472025-06-30T23:52:21.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80482025-06-30T23:52:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80492025-06-30T23:52:21.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80502025-06-30T23:52:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80512025-06-30T23:52:21.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80522025-06-30T23:52:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532025-06-30T23:52:21.576ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80542025-06-30T23:52:21.576ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80552025-06-30T23:52:21.576ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ec27ee7-9ca8-46a3-87a8-e9f718163914", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80562025-06-30T23:52:21.578ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 542.339667ms iteration = 21 status = {}
80572025-06-30T23:52:21.596ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80582025-06-30T23:52:21.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "575f4837-2b42-47e1-8150-60fa9ecf46da", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80592025-06-30T23:52:21.597ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80602025-06-30T23:52:21.598ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c84f05f4-291b-41b9-8aea-8fb2e90c788b", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80612025-06-30T23:52:21.598ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80622025-06-30T23:52:21.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d591c580-6984-44cc-9bab-9a11aa96b3e0", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80632025-06-30T23:52:21.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80642025-06-30T23:52:21.602ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
80652025-06-30T23:52:21.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 576.962247ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80662025-06-30T23:52:21.636ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80672025-06-30T23:52:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80682025-06-30T23:52:21.638ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 612.54897ms iteration = 21 status = null
80692025-06-30T23:52:21.684ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
80702025-06-30T23:52:21.684ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
80712025-06-30T23:52:21.693ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80722025-06-30T23:52:21.693ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "43c8c2f1-6305-466f-af3d-254889de2d5e", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80732025-06-30T23:52:21.693ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80742025-06-30T23:52:21.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f61966bf-2d7b-43c9-a13c-61cc3981c59d", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80752025-06-30T23:52:21.695ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80762025-06-30T23:52:21.697ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80772025-06-30T23:52:21.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 671.620827ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80782025-06-30T23:52:21.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80792025-06-30T23:52:21.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80802025-06-30T23:52:21.702ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80812025-06-30T23:52:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80822025-06-30T23:52:21.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80832025-06-30T23:52:21.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
80842025-06-30T23:52:21.707ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
80852025-06-30T23:52:21.707ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "b7fa834d-ed1a-49ee-af64-4551745ad8fa", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80862025-06-30T23:52:21.708ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
80872025-06-30T23:52:21.709ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 673.218035ms
80882025-06-30T23:52:21.709ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 673.227485ms iteration = 3 status = {}
80892025-06-30T23:52:21.730ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed0c3f62-ac4f-457c-91b3-2d79aee8790a", "content-length": "88560", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
80902025-06-30T23:52:21.732ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80912025-06-30T23:52:21.732ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80922025-06-30T23:52:21.732ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
80932025-06-30T23:52:21.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80942025-06-30T23:52:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80952025-06-30T23:52:21.736ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80962025-06-30T23:52:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80972025-06-30T23:52:21.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80982025-06-30T23:52:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80992025-06-30T23:52:21.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81002025-06-30T23:52:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81012025-06-30T23:52:21.757ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
81022025-06-30T23:52:21.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81032025-06-30T23:52:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81042025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
81052025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
81062025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81072025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81082025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81092025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81102025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81112025-06-30T23:52:21.775ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81122025-06-30T23:52:21.776ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81132025-06-30T23:52:21.776ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81142025-06-30T23:52:21.776ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
81152025-06-30T23:52:21.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81162025-06-30T23:52:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81172025-06-30T23:52:21.778ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
81182025-06-30T23:52:21.778ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81192025-06-30T23:52:21.959ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3b63438d-ddfb-48e5-8230-c27d9b73ed7b", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
81202025-06-30T23:52:21.959ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
81212025-06-30T23:52:21.959ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81222025-06-30T23:52:21.959ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea04b9ae-1ade-4425-aa2e-45c413180748", "content-length": "682", "date": "Mon, 30 Jun 2025 23:52:21 GMT"} })
81232025-06-30T23:52:21.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81242025-06-30T23:52:21.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81252025-06-30T23:52:21.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81262025-06-30T23:52:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81272025-06-30T23:52:21.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81282025-06-30T23:52:21.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292025-06-30T23:52:21.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81302025-06-30T23:52:21.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81312025-06-30T23:52:21.993ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 965.162068ms iteration = 21 status = {}
81322025-06-30T23:52:22.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 932fb0b5-f0ed-4d3c-9f9e-f014d226c90c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81332025-06-30T23:52:22.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 932fb0b5-f0ed-4d3c-9f9e-f014d226c90c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81342025-06-30T23:52:22.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 932fb0b5-f0ed-4d3c-9f9e-f014d226c90c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81352025-06-30T23:52:22.059ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 962a5ec4-edc2-4c1e-a4a0-73563cde5c18 file = nexus/db-queries/src/db/datastore/inventory.rs:1378
81362025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 962a5ec4-edc2-4c1e-a4a0-73563cde5c18 time_started = 2025-06-30 23:52:21.519845 UTC
81372025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
81382025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
81392025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81402025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81412025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 15 reason = Dependency
81422025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
81432025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.62\u{b5}s iteration = 15 status = "Disabled"
81442025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.031407691s iteration = 3 status = {"collection_id":"962a5ec4-edc2-4c1e-a4a0-73563cde5c18","time_done":"2025-06-30 23:52:21.732647 UTC","time_started":"2025-06-30 23:52:21.519845 UTC"}
81452025-06-30T23:52:22.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81462025-06-30T23:52:22.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81472025-06-30T23:52:22.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81482025-06-30T23:52:22.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492025-06-30T23:52:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81502025-06-30T23:52:22.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81512025-06-30T23:52:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81522025-06-30T23:52:22.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81532025-06-30T23:52:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81542025-06-30T23:52:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
81552025-06-30T23:52:22.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81562025-06-30T23:52:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81572025-06-30T23:52:22.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81582025-06-30T23:52:22.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81592025-06-30T23:52:22.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81602025-06-30T23:52:22.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81612025-06-30T23:52:22.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81622025-06-30T23:52:22.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81632025-06-30T23:52:22.091ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.377259ms iteration = 24 status = {"physical_disks_added":0}
81642025-06-30T23:52:22.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81652025-06-30T23:52:22.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81662025-06-30T23:52:22.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81672025-06-30T23:52:22.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81682025-06-30T23:52:22.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81692025-06-30T23:52:22.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81702025-06-30T23:52:22.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81712025-06-30T23:52:22.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81722025-06-30T23:52:22.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81732025-06-30T23:52:22.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81742025-06-30T23:52:22.140ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81752025-06-30T23:52:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81762025-06-30T23:52:22.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81772025-06-30T23:52:22.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81782025-06-30T23:52:22.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81792025-06-30T23:52:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81802025-06-30T23:52:22.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81812025-06-30T23:52:22.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
81822025-06-30T23:52:22.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
81832025-06-30T23:52:22.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
81842025-06-30T23:52:22.151ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
81852025-06-30T23:52:22.151ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 91.879905ms iteration = 6 status = {"blueprint_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","inventory_collection_id":"962a5ec4-edc2-4c1e-a4a0-73563cde5c18","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
81862025-06-30T23:52:23.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a5c222cc-9ae3-4b8a-9777-8f1813f68378 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81872025-06-30T23:52:23.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a5c222cc-9ae3-4b8a-9777-8f1813f68378 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81882025-06-30T23:52:23.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a5c222cc-9ae3-4b8a-9777-8f1813f68378 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81892025-06-30T23:52:24.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6964e40d-1285-482c-b7df-83a6ed409643 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81902025-06-30T23:52:24.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6964e40d-1285-482c-b7df-83a6ed409643 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81912025-06-30T23:52:24.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6964e40d-1285-482c-b7df-83a6ed409643 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81922025-06-30T23:52:24.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 71d7fa01-8055-414b-87c2-ab9aeb351d76 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
81932025-06-30T23:52:25.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 780067c7-4e61-4f52-a033-53ccf10a2bdd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81942025-06-30T23:52:25.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 780067c7-4e61-4f52-a033-53ccf10a2bdd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81952025-06-30T23:52:25.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 780067c7-4e61-4f52-a033-53ccf10a2bdd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81962025-06-30T23:52:26.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6ed843d5-94b8-4b50-93ad-94174b457966 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81972025-06-30T23:52:26.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6ed843d5-94b8-4b50-93ad-94174b457966 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81982025-06-30T23:52:26.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6ed843d5-94b8-4b50-93ad-94174b457966 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
81992025-06-30T23:52:27.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 464b15eb-3504-4edb-bdbd-d171cd0d03fc roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82002025-06-30T23:52:27.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 464b15eb-3504-4edb-bdbd-d171cd0d03fc resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82012025-06-30T23:52:27.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 464b15eb-3504-4edb-bdbd-d171cd0d03fc response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82022025-06-30T23:52:28.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 40cd554f-1f32-4a5e-8782-5645d507849c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82032025-06-30T23:52:28.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 40cd554f-1f32-4a5e-8782-5645d507849c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82042025-06-30T23:52:28.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 40cd554f-1f32-4a5e-8782-5645d507849c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82052025-06-30T23:52:29.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 47bf8615-b1fd-4a91-9086-670efcc07ee1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82062025-06-30T23:52:29.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 47bf8615-b1fd-4a91-9086-670efcc07ee1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82072025-06-30T23:52:29.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 47bf8615-b1fd-4a91-9086-670efcc07ee1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82082025-06-30T23:52:30.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f7dcfc8-9dfc-4703-a826-abc6f9e881ad roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82092025-06-30T23:52:30.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f7dcfc8-9dfc-4703-a826-abc6f9e881ad resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82102025-06-30T23:52:30.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5f7dcfc8-9dfc-4703-a826-abc6f9e881ad response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82112025-06-30T23:52:31.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
82122025-06-30T23:52:31.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
82132025-06-30T23:52:31.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82142025-06-30T23:52:31.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82152025-06-30T23:52:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82162025-06-30T23:52:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82172025-06-30T23:52:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182025-06-30T23:52:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82192025-06-30T23:52:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82202025-06-30T23:52:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82212025-06-30T23:52:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82222025-06-30T23:52:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82232025-06-30T23:52:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82242025-06-30T23:52:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
82252025-06-30T23:52:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262025-06-30T23:52:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272025-06-30T23:52:31.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
82282025-06-30T23:52:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.110388ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
82292025-06-30T23:52:31.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82302025-06-30T23:52:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82312025-06-30T23:52:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.708773ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82322025-06-30T23:52:31.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1839d213-4587-43ae-81f6-42680ba6d9b3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82332025-06-30T23:52:31.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1839d213-4587-43ae-81f6-42680ba6d9b3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82342025-06-30T23:52:31.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1839d213-4587-43ae-81f6-42680ba6d9b3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82352025-06-30T23:52:32.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4bb8ce64-9aeb-4af6-8f2b-247dba736342 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82362025-06-30T23:52:32.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4bb8ce64-9aeb-4af6-8f2b-247dba736342 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82372025-06-30T23:52:32.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4bb8ce64-9aeb-4af6-8f2b-247dba736342 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82382025-06-30T23:52:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e86578af-24b6-4921-a7a7-0385293edee9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82392025-06-30T23:52:33.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e86578af-24b6-4921-a7a7-0385293edee9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82402025-06-30T23:52:33.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e86578af-24b6-4921-a7a7-0385293edee9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82412025-06-30T23:52:34.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f49058cb-b6cb-4d62-b1e7-5294ac6905da roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82422025-06-30T23:52:34.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f49058cb-b6cb-4d62-b1e7-5294ac6905da resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82432025-06-30T23:52:34.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f49058cb-b6cb-4d62-b1e7-5294ac6905da response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82442025-06-30T23:52:34.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = ba67f255-08cc-4ee9-b02f-02102ef8ad37 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
82452025-06-30T23:52:34.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = ba67f255-08cc-4ee9-b02f-02102ef8ad37 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
82462025-06-30T23:52:34.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = ba67f255-08cc-4ee9-b02f-02102ef8ad37 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
82472025-06-30T23:52:34.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f71df9cd-eb23-44c1-a0da-72d3ba3350bd roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
82482025-06-30T23:52:34.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f71df9cd-eb23-44c1-a0da-72d3ba3350bd resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
82492025-06-30T23:52:34.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62520 req_id = f71df9cd-eb23-44c1-a0da-72d3ba3350bd response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
82502025-06-30T23:52:34.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 510 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = a95be4cb-a39a-4074-8b7d-987eabc6fc03 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
82512025-06-30T23:52:35.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e0487558-e438-4c05-8ede-8a4d88024af3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82522025-06-30T23:52:35.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e0487558-e438-4c05-8ede-8a4d88024af3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82532025-06-30T23:52:35.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e0487558-e438-4c05-8ede-8a4d88024af3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82542025-06-30T23:52:36.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 80d74b26-0049-416f-aa80-5a406e227d4c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82552025-06-30T23:52:36.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 80d74b26-0049-416f-aa80-5a406e227d4c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82562025-06-30T23:52:36.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 80d74b26-0049-416f-aa80-5a406e227d4c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82572025-06-30T23:52:37.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0e3d9cfb-6fee-4607-aac4-6f94bb23fbfb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82582025-06-30T23:52:37.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0e3d9cfb-6fee-4607-aac4-6f94bb23fbfb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82592025-06-30T23:52:37.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0e3d9cfb-6fee-4607-aac4-6f94bb23fbfb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82602025-06-30T23:52:38.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c57631f-0eba-4b51-9b2f-ca85670f0247 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82612025-06-30T23:52:38.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c57631f-0eba-4b51-9b2f-ca85670f0247 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82622025-06-30T23:52:38.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4c57631f-0eba-4b51-9b2f-ca85670f0247 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82632025-06-30T23:52:39.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1b86fcb9-dc2b-4998-8709-0ae5e63397c8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82642025-06-30T23:52:39.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1b86fcb9-dc2b-4998-8709-0ae5e63397c8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82652025-06-30T23:52:39.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1b86fcb9-dc2b-4998-8709-0ae5e63397c8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82662025-06-30T23:52:40.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 536a117d-8bb0-410b-876b-c102f8ebcd69 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82672025-06-30T23:52:40.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 536a117d-8bb0-410b-876b-c102f8ebcd69 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82682025-06-30T23:52:40.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 536a117d-8bb0-410b-876b-c102f8ebcd69 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82692025-06-30T23:52:41.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
82702025-06-30T23:52:41.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
82712025-06-30T23:52:41.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82722025-06-30T23:52:41.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82732025-06-30T23:52:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82742025-06-30T23:52:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82752025-06-30T23:52:41.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82762025-06-30T23:52:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82772025-06-30T23:52:41.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82782025-06-30T23:52:41.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.953562ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82792025-06-30T23:52:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82802025-06-30T23:52:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82812025-06-30T23:52:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82822025-06-30T23:52:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82832025-06-30T23:52:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82842025-06-30T23:52:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82852025-06-30T23:52:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
82862025-06-30T23:52:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82872025-06-30T23:52:41.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82882025-06-30T23:52:41.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
82892025-06-30T23:52:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.699758ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
82902025-06-30T23:52:41.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45f77c03-c95f-48dc-af24-e5749ef96756 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82912025-06-30T23:52:41.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45f77c03-c95f-48dc-af24-e5749ef96756 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82922025-06-30T23:52:41.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 45f77c03-c95f-48dc-af24-e5749ef96756 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82932025-06-30T23:52:42.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e365131a-0f2a-4208-a3b9-065b58f4c843 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82942025-06-30T23:52:42.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e365131a-0f2a-4208-a3b9-065b58f4c843 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82952025-06-30T23:52:42.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e365131a-0f2a-4208-a3b9-065b58f4c843 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82962025-06-30T23:52:43.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fd4a775-76f4-4a3c-b64f-276c1873f725 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82972025-06-30T23:52:43.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fd4a775-76f4-4a3c-b64f-276c1873f725 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82982025-06-30T23:52:43.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fd4a775-76f4-4a3c-b64f-276c1873f725 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
82992025-06-30T23:52:44.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 553 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = c3a4fcee-7fa9-42dd-847f-0266fffb7071 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
83002025-06-30T23:52:44.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec08c6e0-2701-4a02-92c4-5135ca3de75b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83012025-06-30T23:52:44.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec08c6e0-2701-4a02-92c4-5135ca3de75b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83022025-06-30T23:52:44.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ec08c6e0-2701-4a02-92c4-5135ca3de75b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83032025-06-30T23:52:45.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1556f9f1-65ed-48e5-8999-9f5f6192d06b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83042025-06-30T23:52:45.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1556f9f1-65ed-48e5-8999-9f5f6192d06b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83052025-06-30T23:52:45.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1556f9f1-65ed-48e5-8999-9f5f6192d06b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83062025-06-30T23:52:46.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e73ebeb4-ce01-4e94-b6da-266e7980b036 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83072025-06-30T23:52:46.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e73ebeb4-ce01-4e94-b6da-266e7980b036 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83082025-06-30T23:52:46.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e73ebeb4-ce01-4e94-b6da-266e7980b036 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83092025-06-30T23:52:47.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de4ee539-1939-4023-875f-58b0e78943a5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83102025-06-30T23:52:47.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de4ee539-1939-4023-875f-58b0e78943a5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83112025-06-30T23:52:47.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de4ee539-1939-4023-875f-58b0e78943a5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83122025-06-30T23:52:48.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4f07816f-0cab-4256-912d-19b5bfcbb958 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83132025-06-30T23:52:48.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4f07816f-0cab-4256-912d-19b5bfcbb958 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83142025-06-30T23:52:48.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4f07816f-0cab-4256-912d-19b5bfcbb958 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83152025-06-30T23:52:49.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b95ca52-0c7e-419f-b10a-da3cdbae7b41 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83162025-06-30T23:52:49.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b95ca52-0c7e-419f-b10a-da3cdbae7b41 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83172025-06-30T23:52:49.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b95ca52-0c7e-419f-b10a-da3cdbae7b41 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83182025-06-30T23:52:50.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 489f6114-82f6-44b5-9391-bbad3e1ba4e5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83192025-06-30T23:52:50.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 489f6114-82f6-44b5-9391-bbad3e1ba4e5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83202025-06-30T23:52:50.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 489f6114-82f6-44b5-9391-bbad3e1ba4e5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
83212025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
83222025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
83232025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
83242025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83252025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83262025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83272025-06-30T23:52:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83282025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
83292025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
83302025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83312025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83322025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
83332025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
83342025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83352025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83362025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
83372025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
83382025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83392025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83402025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
83412025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83422025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
83432025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83442025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83452025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83462025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83472025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83482025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83492025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83502025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83512025-06-30T23:52:51.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83522025-06-30T23:52:51.029ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.177213ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83532025-06-30T23:52:51.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 665853905 } })
83542025-06-30T23:52:51.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 665924867 } })
83552025-06-30T23:52:51.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
83562025-06-30T23:52:51.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
83572025-06-30T23:52:51.031ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83582025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83592025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83602025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83612025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83622025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83632025-06-30T23:52:51.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83642025-06-30T23:52:51.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83652025-06-30T23:52:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83662025-06-30T23:52:51.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83672025-06-30T23:52:51.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83682025-06-30T23:52:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83692025-06-30T23:52:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.862416ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83702025-06-30T23:52:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.013649ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83712025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83722025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83732025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
83742025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83752025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
83762025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83772025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
83782025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83792025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
83802025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
83812025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
83822025-06-30T23:52:51.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83832025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
83842025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83852025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
83862025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83872025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83882025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83892025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83902025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
83912025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83922025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83932025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83942025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
83952025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83962025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83972025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83982025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83992025-06-30T23:52:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84002025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84012025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84022025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84032025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84042025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84052025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84062025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84072025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84082025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84092025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
84102025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84112025-06-30T23:52:51.037ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 674267830 } })
84122025-06-30T23:52:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84132025-06-30T23:52:51.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84142025-06-30T23:52:51.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84152025-06-30T23:52:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84162025-06-30T23:52:51.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84172025-06-30T23:52:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84182025-06-30T23:52:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84192025-06-30T23:52:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84202025-06-30T23:52:51.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84212025-06-30T23:52:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84222025-06-30T23:52:51.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84232025-06-30T23:52:51.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 680151876 } })
84242025-06-30T23:52:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84252025-06-30T23:52:51.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
84262025-06-30T23:52:51.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84272025-06-30T23:52:51.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84282025-06-30T23:52:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84292025-06-30T23:52:51.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84302025-06-30T23:52:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84312025-06-30T23:52:51.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84322025-06-30T23:52:51.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332025-06-30T23:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84342025-06-30T23:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84352025-06-30T23:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84362025-06-30T23:52:51.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84372025-06-30T23:52:51.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84382025-06-30T23:52:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84392025-06-30T23:52:51.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84402025-06-30T23:52:51.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84412025-06-30T23:52:51.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84422025-06-30T23:52:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84432025-06-30T23:52:51.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.131539ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
84442025-06-30T23:52:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.386941ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
84452025-06-30T23:52:51.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84462025-06-30T23:52:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84472025-06-30T23:52:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84482025-06-30T23:52:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84492025-06-30T23:52:51.094ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84502025-06-30T23:52:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84512025-06-30T23:52:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.631069ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
84522025-06-30T23:52:51.096ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84532025-06-30T23:52:51.096ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84542025-06-30T23:52:51.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84552025-06-30T23:52:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84562025-06-30T23:52:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 60.283254ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84572025-06-30T23:52:51.097ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84582025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84592025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84602025-06-30T23:52:51.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84612025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84622025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84632025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84642025-06-30T23:52:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84652025-06-30T23:52:51.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.808156ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84662025-06-30T23:52:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84672025-06-30T23:52:51.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84682025-06-30T23:52:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84692025-06-30T23:52:51.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84702025-06-30T23:52:51.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84712025-06-30T23:52:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
84722025-06-30T23:52:51.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84732025-06-30T23:52:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84742025-06-30T23:52:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84752025-06-30T23:52:51.102ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
84762025-06-30T23:52:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 73.949861ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
84772025-06-30T23:52:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84782025-06-30T23:52:51.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84792025-06-30T23:52:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84802025-06-30T23:52:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84812025-06-30T23:52:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84822025-06-30T23:52:51.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84832025-06-30T23:52:51.107ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84842025-06-30T23:52:51.107ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.976802ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84852025-06-30T23:52:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
84862025-06-30T23:52:51.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84872025-06-30T23:52:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84882025-06-30T23:52:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.626758ms iteration = 22 status = 0
84892025-06-30T23:52:51.115ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
84902025-06-30T23:52:51.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.270408ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
84912025-06-30T23:52:51.127ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
84922025-06-30T23:52:51.127ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84932025-06-30T23:52:51.127ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21d380a0-b8db-42c6-91bd-fc9add74b12c", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
84942025-06-30T23:52:51.127ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84952025-06-30T23:52:51.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84962025-06-30T23:52:51.136ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
84972025-06-30T23:52:51.136ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84982025-06-30T23:52:51.137ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40bed980-cca4-46e6-b92c-f7bf17c1667e", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
84992025-06-30T23:52:51.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85002025-06-30T23:52:51.139ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85012025-06-30T23:52:51.139ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85022025-06-30T23:52:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.761257ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85032025-06-30T23:52:51.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85042025-06-30T23:52:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.852137ms iteration = 25 status = {"physical_disks_added":0}
85052025-06-30T23:52:51.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
85062025-06-30T23:52:51.204ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85072025-06-30T23:52:51.205ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb6464b0-c695-4c6d-a6b5-2df63d253805", "content-length": "26", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85082025-06-30T23:52:51.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85092025-06-30T23:52:51.205ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
85102025-06-30T23:52:51.205ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "2098a2fb-9852-45ef-b0d3-f55825d95951", "content-length": "78", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85112025-06-30T23:52:51.205ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
85122025-06-30T23:52:51.205ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
85132025-06-30T23:52:51.205ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
85142025-06-30T23:52:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
85152025-06-30T23:52:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
85162025-06-30T23:52:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
85172025-06-30T23:52:51.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
85182025-06-30T23:52:51.207ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
85192025-06-30T23:52:51.208ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
85202025-06-30T23:52:51.208ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
85212025-06-30T23:52:51.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
85222025-06-30T23:52:51.210ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
85232025-06-30T23:52:51.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
85242025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
85252025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
85262025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
85272025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
85282025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
85292025-06-30T23:52:51.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
85302025-06-30T23:52:51.212ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
85312025-06-30T23:52:51.212ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
85322025-06-30T23:52:51.213ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e85e15ab-8f79-4815-9861-7b7808478654", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85332025-06-30T23:52:51.213ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
85342025-06-30T23:52:51.213ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
85352025-06-30T23:52:51.213ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b440d66-5f6b-4f33-87d7-9faba1a505ce", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85362025-06-30T23:52:51.246ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
85372025-06-30T23:52:51.246ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
85382025-06-30T23:52:51.246ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f8c208-f5f9-4f69-a26a-b40133a2ec4c", "content-length": "81", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85392025-06-30T23:52:51.248ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 210.844637ms iteration = 22 status = {"errors":[],"sps":[]}
85402025-06-30T23:52:51.261ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.257932ms iteration = 22 status = {}
85412025-06-30T23:52:51.271ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85422025-06-30T23:52:51.272ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ad779a6-2a1a-478e-aa05-bd856b044f18", "content-length": "691", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85432025-06-30T23:52:51.272ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85442025-06-30T23:52:51.272ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85452025-06-30T23:52:51.272ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85462025-06-30T23:52:51.274ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 245.820566ms iteration = 22 status = {}
85472025-06-30T23:52:51.275ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85482025-06-30T23:52:51.275ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85492025-06-30T23:52:51.276ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "86ae514d-1ca7-4886-9f1a-dba1b1c3c1cc", "content-length": "372", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85502025-06-30T23:52:51.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85512025-06-30T23:52:51.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85522025-06-30T23:52:51.277ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85532025-06-30T23:52:51.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85542025-06-30T23:52:51.280ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.884563ms iteration = 22 status = null
85552025-06-30T23:52:51.289ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85562025-06-30T23:52:51.289ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85572025-06-30T23:52:51.289ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "66d62b10-edeb-46c3-8196-e719d64a84c5", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85582025-06-30T23:52:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85592025-06-30T23:52:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85602025-06-30T23:52:51.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85612025-06-30T23:52:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85622025-06-30T23:52:51.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85632025-06-30T23:52:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85642025-06-30T23:52:51.298ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85652025-06-30T23:52:51.298ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85662025-06-30T23:52:51.298ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63f0ec87-b812-42d8-aaf8-959c5fbb01e1", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85672025-06-30T23:52:51.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 263.828583ms iteration = 22 status = {}
85682025-06-30T23:52:51.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85692025-06-30T23:52:51.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85702025-06-30T23:52:51.348ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
85712025-06-30T23:52:51.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85722025-06-30T23:52:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85732025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
85742025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
85752025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85762025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85772025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85782025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85792025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85802025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85812025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85822025-06-30T23:52:51.360ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85832025-06-30T23:52:51.361ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
85842025-06-30T23:52:51.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85852025-06-30T23:52:51.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85862025-06-30T23:52:51.363ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
85872025-06-30T23:52:51.363ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85882025-06-30T23:52:51.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05f2d1dc-bb2c-4611-9f93-bf87e0af706c", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85892025-06-30T23:52:51.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
85902025-06-30T23:52:51.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85912025-06-30T23:52:51.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ece6924-6f0f-45d2-a05d-2b7ae9a7aca8", "content-length": "682", "date": "Mon, 30 Jun 2025 23:52:51 GMT"} })
85922025-06-30T23:52:51.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85932025-06-30T23:52:51.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85942025-06-30T23:52:51.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85952025-06-30T23:52:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85962025-06-30T23:52:51.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85972025-06-30T23:52:51.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85982025-06-30T23:52:51.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85992025-06-30T23:52:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86002025-06-30T23:52:51.482ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 454.264788ms iteration = 22 status = {}
86012025-06-30T23:52:51.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eca55572-79ab-4ff5-9790-20a0668feb0a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86022025-06-30T23:52:51.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eca55572-79ab-4ff5-9790-20a0668feb0a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86032025-06-30T23:52:51.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eca55572-79ab-4ff5-9790-20a0668feb0a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86042025-06-30T23:52:52.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 617e8a6a-441e-4e0b-a808-be3d42703ea4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86052025-06-30T23:52:52.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 617e8a6a-441e-4e0b-a808-be3d42703ea4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86062025-06-30T23:52:52.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 617e8a6a-441e-4e0b-a808-be3d42703ea4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86072025-06-30T23:52:53.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43f6cf42-e1b9-4954-9f94-7c9d52133108 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86082025-06-30T23:52:53.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43f6cf42-e1b9-4954-9f94-7c9d52133108 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86092025-06-30T23:52:53.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 43f6cf42-e1b9-4954-9f94-7c9d52133108 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86102025-06-30T23:52:54.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 604 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 7d786976-f0e1-4d18-a54d-44befe8b195d response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
86112025-06-30T23:52:54.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1ba1cba-5be8-4183-9ae3-3c360e307ec3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86122025-06-30T23:52:54.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1ba1cba-5be8-4183-9ae3-3c360e307ec3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86132025-06-30T23:52:54.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a1ba1cba-5be8-4183-9ae3-3c360e307ec3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86142025-06-30T23:52:55.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c8050d-eada-49e6-be70-b6575d124431 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86152025-06-30T23:52:55.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c8050d-eada-49e6-be70-b6575d124431 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86162025-06-30T23:52:55.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9c8050d-eada-49e6-be70-b6575d124431 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86172025-06-30T23:52:56.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4855d2df-02d6-499e-aa60-fe6275f7c796 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86182025-06-30T23:52:56.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4855d2df-02d6-499e-aa60-fe6275f7c796 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86192025-06-30T23:52:56.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4855d2df-02d6-499e-aa60-fe6275f7c796 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86202025-06-30T23:52:57.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b119d0ab-7b23-47fe-bf66-3ebd036f6fb1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86212025-06-30T23:52:57.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b119d0ab-7b23-47fe-bf66-3ebd036f6fb1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86222025-06-30T23:52:57.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b119d0ab-7b23-47fe-bf66-3ebd036f6fb1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86232025-06-30T23:52:58.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e2367c7-8a86-48be-b1b2-cb249ad5677a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86242025-06-30T23:52:58.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e2367c7-8a86-48be-b1b2-cb249ad5677a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86252025-06-30T23:52:58.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e2367c7-8a86-48be-b1b2-cb249ad5677a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86262025-06-30T23:52:59.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fd5d7c8e-535d-4df0-bffc-cf52928d56a8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86272025-06-30T23:52:59.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fd5d7c8e-535d-4df0-bffc-cf52928d56a8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86282025-06-30T23:52:59.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = fd5d7c8e-535d-4df0-bffc-cf52928d56a8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86292025-06-30T23:53:00.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d8ed946-f970-49e2-b685-64fe0aac39f9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86302025-06-30T23:53:00.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d8ed946-f970-49e2-b685-64fe0aac39f9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86312025-06-30T23:53:00.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1d8ed946-f970-49e2-b685-64fe0aac39f9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86322025-06-30T23:53:01.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
86332025-06-30T23:53:01.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86342025-06-30T23:53:01.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
86352025-06-30T23:53:01.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86362025-06-30T23:53:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86372025-06-30T23:53:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86382025-06-30T23:53:01.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392025-06-30T23:53:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86402025-06-30T23:53:01.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86412025-06-30T23:53:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86422025-06-30T23:53:01.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86432025-06-30T23:53:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86442025-06-30T23:53:01.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452025-06-30T23:53:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
86462025-06-30T23:53:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86472025-06-30T23:53:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86482025-06-30T23:53:01.051ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
86492025-06-30T23:53:01.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.796987ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
86502025-06-30T23:53:01.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86512025-06-30T23:53:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86522025-06-30T23:53:01.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.16415ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86532025-06-30T23:53:01.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39888cc2-f228-44b5-8e3a-2b27a766b9f0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86542025-06-30T23:53:01.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39888cc2-f228-44b5-8e3a-2b27a766b9f0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86552025-06-30T23:53:01.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 39888cc2-f228-44b5-8e3a-2b27a766b9f0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86562025-06-30T23:53:02.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8156703-8f61-4768-b136-afa09b80ac81 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86572025-06-30T23:53:02.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8156703-8f61-4768-b136-afa09b80ac81 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86582025-06-30T23:53:02.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f8156703-8f61-4768-b136-afa09b80ac81 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86592025-06-30T23:53:03.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a00604c6-daee-4afd-b6ec-2df07b600f81 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86602025-06-30T23:53:03.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a00604c6-daee-4afd-b6ec-2df07b600f81 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86612025-06-30T23:53:03.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a00604c6-daee-4afd-b6ec-2df07b600f81 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86622025-06-30T23:53:04.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 697c9e8d-18aa-49c9-80c1-6c1fdb42ac83 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
86632025-06-30T23:53:04.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 485a635b-74d2-4f4c-bdbc-0b56691e27c3 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86642025-06-30T23:53:04.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 485a635b-74d2-4f4c-bdbc-0b56691e27c3 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86652025-06-30T23:53:04.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 485a635b-74d2-4f4c-bdbc-0b56691e27c3 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86662025-06-30T23:53:05.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 89a12076-47e9-47e3-909a-36ac4763b016 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86672025-06-30T23:53:05.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 89a12076-47e9-47e3-909a-36ac4763b016 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86682025-06-30T23:53:05.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 89a12076-47e9-47e3-909a-36ac4763b016 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86692025-06-30T23:53:06.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66f17bfe-a08b-472a-ae80-f6a1d0797a34 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86702025-06-30T23:53:06.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66f17bfe-a08b-472a-ae80-f6a1d0797a34 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86712025-06-30T23:53:06.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66f17bfe-a08b-472a-ae80-f6a1d0797a34 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86722025-06-30T23:53:07.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eefc6379-d125-4462-8322-a3f79b4d3a76 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86732025-06-30T23:53:07.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eefc6379-d125-4462-8322-a3f79b4d3a76 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86742025-06-30T23:53:07.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eefc6379-d125-4462-8322-a3f79b4d3a76 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86752025-06-30T23:53:08.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d85a7bbb-95f2-4254-94d8-340f62494072 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86762025-06-30T23:53:08.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d85a7bbb-95f2-4254-94d8-340f62494072 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86772025-06-30T23:53:08.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d85a7bbb-95f2-4254-94d8-340f62494072 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86782025-06-30T23:53:09.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbe568da-5103-43a0-9f33-fa333a6fb6c4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86792025-06-30T23:53:09.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbe568da-5103-43a0-9f33-fa333a6fb6c4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86802025-06-30T23:53:09.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = cbe568da-5103-43a0-9f33-fa333a6fb6c4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86812025-06-30T23:53:10.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10bbe0e0-e079-4162-86db-4574390a8466 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86822025-06-30T23:53:10.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10bbe0e0-e079-4162-86db-4574390a8466 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86832025-06-30T23:53:10.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10bbe0e0-e079-4162-86db-4574390a8466 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
86842025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
86852025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
86862025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86872025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86882025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86892025-06-30T23:53:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86902025-06-30T23:53:11.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912025-06-30T23:53:11.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86922025-06-30T23:53:11.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86932025-06-30T23:53:11.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.037436ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86942025-06-30T23:53:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86952025-06-30T23:53:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86962025-06-30T23:53:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86972025-06-30T23:53:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86982025-06-30T23:53:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86992025-06-30T23:53:11.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87002025-06-30T23:53:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
87012025-06-30T23:53:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87022025-06-30T23:53:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87032025-06-30T23:53:11.053ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
87042025-06-30T23:53:11.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.615003ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
87052025-06-30T23:53:11.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e1c97592-707e-4418-96e9-69a621e69085 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87062025-06-30T23:53:11.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e1c97592-707e-4418-96e9-69a621e69085 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87072025-06-30T23:53:11.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e1c97592-707e-4418-96e9-69a621e69085 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87082025-06-30T23:53:12.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2298f90d-fd7a-407b-9976-0692afb19cd5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87092025-06-30T23:53:12.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2298f90d-fd7a-407b-9976-0692afb19cd5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87102025-06-30T23:53:12.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2298f90d-fd7a-407b-9976-0692afb19cd5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87112025-06-30T23:53:13.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e9f83c6-aa29-415b-b486-b2a7cd3c441e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87122025-06-30T23:53:13.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e9f83c6-aa29-415b-b486-b2a7cd3c441e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87132025-06-30T23:53:13.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8e9f83c6-aa29-415b-b486-b2a7cd3c441e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87142025-06-30T23:53:14.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 12411d2a-51a9-4e70-87aa-d523dec9cab7 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
87152025-06-30T23:53:14.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de19703c-a59c-4a36-bf1a-293112736fcd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87162025-06-30T23:53:14.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de19703c-a59c-4a36-bf1a-293112736fcd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87172025-06-30T23:53:14.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = de19703c-a59c-4a36-bf1a-293112736fcd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87182025-06-30T23:53:15.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b959b70-e784-40f3-b9c0-4aab49f0e223 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87192025-06-30T23:53:15.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b959b70-e784-40f3-b9c0-4aab49f0e223 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87202025-06-30T23:53:15.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4b959b70-e784-40f3-b9c0-4aab49f0e223 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87212025-06-30T23:53:16.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8eef43-7997-4fe5-97eb-54d58872b608 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87222025-06-30T23:53:16.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8eef43-7997-4fe5-97eb-54d58872b608 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87232025-06-30T23:53:16.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1e8eef43-7997-4fe5-97eb-54d58872b608 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87242025-06-30T23:53:17.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f94eef9-be2c-4aee-acfd-1de088f7676d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87252025-06-30T23:53:17.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f94eef9-be2c-4aee-acfd-1de088f7676d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87262025-06-30T23:53:17.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f94eef9-be2c-4aee-acfd-1de088f7676d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87272025-06-30T23:53:18.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8a507726-8fd9-4908-b953-669004792573 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87282025-06-30T23:53:18.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8a507726-8fd9-4908-b953-669004792573 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87292025-06-30T23:53:18.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8a507726-8fd9-4908-b953-669004792573 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87302025-06-30T23:53:19.320ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:63956
87312025-06-30T23:53:19.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = 23298314-283e-4a5a-94fa-8d323b0a07be roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
87322025-06-30T23:53:19.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = 23298314-283e-4a5a-94fa-8d323b0a07be resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
87332025-06-30T23:53:19.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = 23298314-283e-4a5a-94fa-8d323b0a07be response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?sort_by=id_ascending
87342025-06-30T23:53:19.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = e4ad5daf-5353-4152-9831-68e760d6ec81 roles = RoleSet { roles: {} } uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
87352025-06-30T23:53:19.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = e4ad5daf-5353-4152-9831-68e760d6ec81 resource = Database result = Ok(()) uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
87362025-06-30T23:53:19.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:63956 req_id = e4ad5daf-5353-4152-9831-68e760d6ec81 response_code = 200 uri = /metrics/collectors/ab61cc82-0c40-43e5-9ce0-30d732f070d1/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZDkxY2Q5Mi1iZmFhLTQ3ZmYtOTE1OS1iMzk4ZTgwNDg5NWYifX0%3D
87372025-06-30T23:53:19.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eeb235d4-8104-476d-8c31-cc4d7e197146 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87382025-06-30T23:53:19.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eeb235d4-8104-476d-8c31-cc4d7e197146 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87392025-06-30T23:53:19.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = eeb235d4-8104-476d-8c31-cc4d7e197146 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87402025-06-30T23:53:21.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10160046-0c04-4344-b3b4-1b86f424c1a4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87412025-06-30T23:53:21.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10160046-0c04-4344-b3b4-1b86f424c1a4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87422025-06-30T23:53:21.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 10160046-0c04-4344-b3b4-1b86f424c1a4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
87432025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
87442025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
87452025-06-30T23:53:21.025ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
87462025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
87472025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87482025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.371\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
87492025-06-30T23:53:21.025ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:43:21.025807783 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87502025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87512025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
87522025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
87532025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
87542025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
87552025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
87562025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87572025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87582025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87592025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87602025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
87612025-06-30T23:53:21.025ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87622025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
87632025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
87642025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87652025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
87662025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87672025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87682025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87692025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87702025-06-30T23:53:21.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 662746713 } })
87712025-06-30T23:53:21.026ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 662749073 } })
87722025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87732025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87742025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
87752025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.019523ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
87762025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
87772025-06-30T23:53:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.038424ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
87782025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
87792025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 16 reason = Timeout
87802025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
87812025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
87822025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 6.1\u{b5}s iteration = 16 status = "Disabled"
87832025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87842025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
87852025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87862025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
87872025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87882025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
87892025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87902025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87912025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
87922025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
87932025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87942025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87952025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
87962025-06-30T23:53:21.027ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
87972025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87982025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
87992025-06-30T23:53:21.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88002025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88012025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88022025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88032025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88042025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88052025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88062025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88072025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88082025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88092025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88102025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88112025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88122025-06-30T23:53:21.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88132025-06-30T23:53:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88142025-06-30T23:53:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.109492ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88152025-06-30T23:53:21.029ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:43:21.025807783 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88162025-06-30T23:53:21.029ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.988303ms iteration = 12 status = {"expiration":"2025-06-30T23:43:21.025807783Z","pruned":[]}
88172025-06-30T23:53:21.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88182025-06-30T23:53:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88192025-06-30T23:53:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88202025-06-30T23:53:21.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 667248957 } })
88212025-06-30T23:53:21.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
88222025-06-30T23:53:21.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 668043896 } })
88232025-06-30T23:53:21.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
88242025-06-30T23:53:21.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252025-06-30T23:53:21.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88262025-06-30T23:53:21.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88272025-06-30T23:53:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88282025-06-30T23:53:21.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292025-06-30T23:53:21.034ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88302025-06-30T23:53:21.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312025-06-30T23:53:21.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88322025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
88332025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88342025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
88352025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
88362025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
88372025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88382025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
88392025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88402025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
88412025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88422025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88432025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
88442025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88452025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88462025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
88472025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88482025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
88492025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
88502025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88512025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88522025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88532025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
88542025-06-30T23:53:21.035ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88552025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88562025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
88572025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
88582025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
88592025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88602025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
88612025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
88622025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
88632025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88642025-06-30T23:53:21.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88652025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
88662025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88672025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88682025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88692025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
88702025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88712025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88722025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88732025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88742025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88752025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
88762025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88772025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88782025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88792025-06-30T23:53:21.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88802025-06-30T23:53:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88812025-06-30T23:53:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88822025-06-30T23:53:21.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88832025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88842025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88852025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
88862025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88872025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88882025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88892025-06-30T23:53:21.038ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
88902025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 2.988739ms iteration = 12 status = {"by_rx":{},"error":null}
88912025-06-30T23:53:21.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 674959996 } })
88922025-06-30T23:53:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88932025-06-30T23:53:21.039ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88942025-06-30T23:53:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88952025-06-30T23:53:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88962025-06-30T23:53:21.040ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88972025-06-30T23:53:21.040ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88982025-06-30T23:53:21.040ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.396855ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88992025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89002025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89012025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89022025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89032025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89042025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89052025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89062025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89072025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89082025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89092025-06-30T23:53:21.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89102025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89112025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89122025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89132025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89142025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89152025-06-30T23:53:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89162025-06-30T23:53:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.461133ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
89172025-06-30T23:53:21.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89182025-06-30T23:53:21.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89192025-06-30T23:53:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89202025-06-30T23:53:21.044ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212025-06-30T23:53:21.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 681593319 } })
89222025-06-30T23:53:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 9.697424ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
89232025-06-30T23:53:21.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
89242025-06-30T23:53:21.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89252025-06-30T23:53:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89262025-06-30T23:53:21.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89272025-06-30T23:53:21.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89282025-06-30T23:53:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89292025-06-30T23:53:21.047ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
89302025-06-30T23:53:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
89312025-06-30T23:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89322025-06-30T23:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89332025-06-30T23:53:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89342025-06-30T23:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89352025-06-30T23:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362025-06-30T23:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89372025-06-30T23:53:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89382025-06-30T23:53:21.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89392025-06-30T23:53:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89402025-06-30T23:53:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 15.504119ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
89412025-06-30T23:53:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89422025-06-30T23:53:21.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89432025-06-30T23:53:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89442025-06-30T23:53:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89452025-06-30T23:53:21.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89462025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89472025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89482025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89492025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89502025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89512025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89522025-06-30T23:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89532025-06-30T23:53:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.275623ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
89542025-06-30T23:53:21.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89552025-06-30T23:53:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89562025-06-30T23:53:21.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89572025-06-30T23:53:21.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89582025-06-30T23:53:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89592025-06-30T23:53:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89602025-06-30T23:53:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.212879ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
89612025-06-30T23:53:21.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89622025-06-30T23:53:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89632025-06-30T23:53:21.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.526228ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89642025-06-30T23:53:21.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89652025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89662025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89672025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89682025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89692025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89702025-06-30T23:53:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89712025-06-30T23:53:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.085329ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89722025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89732025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
89742025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89752025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89762025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89772025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89782025-06-30T23:53:21.110ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
89792025-06-30T23:53:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.0022ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89802025-06-30T23:53:21.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89812025-06-30T23:53:21.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89822025-06-30T23:53:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89832025-06-30T23:53:21.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89842025-06-30T23:53:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89852025-06-30T23:53:21.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89862025-06-30T23:53:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89872025-06-30T23:53:21.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89882025-06-30T23:53:21.113ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89892025-06-30T23:53:21.113ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
89902025-06-30T23:53:21.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89912025-06-30T23:53:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89922025-06-30T23:53:21.114ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89932025-06-30T23:53:21.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89942025-06-30T23:53:21.114ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89952025-06-30T23:53:21.114ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89962025-06-30T23:53:21.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89972025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89982025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89992025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90002025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90012025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90022025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032025-06-30T23:53:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90042025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90052025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90062025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90072025-06-30T23:53:21.117ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90082025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90092025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90102025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90112025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90122025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90132025-06-30T23:53:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90142025-06-30T23:53:21.118ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
90152025-06-30T23:53:21.118ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90162025-06-30T23:53:21.118ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
90172025-06-30T23:53:21.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 92.826517ms iteration = 12 status = {"generation":1}
90182025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
90192025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90202025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90212025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90222025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90232025-06-30T23:53:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90242025-06-30T23:53:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.708578ms iteration = 23 status = 0
90252025-06-30T23:53:21.121ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
90262025-06-30T23:53:21.121ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90272025-06-30T23:53:21.121ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
90282025-06-30T23:53:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 96.057302ms iteration = 12 status = {"generation":2}
90292025-06-30T23:53:21.126ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.225522ms iteration = 26 status = {"physical_disks_added":0}
90302025-06-30T23:53:21.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
90312025-06-30T23:53:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.726997ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
90322025-06-30T23:53:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.385145ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90332025-06-30T23:53:21.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90342025-06-30T23:53:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90352025-06-30T23:53:21.152ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90362025-06-30T23:53:21.152ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90372025-06-30T23:53:21.152ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.179601ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90382025-06-30T23:53:21.156ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
90392025-06-30T23:53:21.156ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.316608ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
90402025-06-30T23:53:21.179ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
90412025-06-30T23:53:21.179ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 153.505541ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90422025-06-30T23:53:21.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.403135ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
90432025-06-30T23:53:21.195ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
90442025-06-30T23:53:21.195ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 160.135065ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90452025-06-30T23:53:21.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90462025-06-30T23:53:21.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90472025-06-30T23:53:21.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90482025-06-30T23:53:21.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90492025-06-30T23:53:21.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90502025-06-30T23:53:21.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90512025-06-30T23:53:21.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90522025-06-30T23:53:21.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90532025-06-30T23:53:21.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90542025-06-30T23:53:21.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90552025-06-30T23:53:21.336ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90562025-06-30T23:53:21.336ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90572025-06-30T23:53:21.337ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c266355d-1d59-4989-8374-28fce552bd45", "content-length": "523", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
90582025-06-30T23:53:21.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90592025-06-30T23:53:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90602025-06-30T23:53:21.355ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {a2b4ff37-79e0-4d92-8b03-b6c8933f7ceb: {10.151.2.176: {3c4c4d2c-75e7-4f5f-9b9c-2b9bbaf10a63}, 10.151.2.175: {3c4c4d2c-75e7-4f5f-9b9c-2b9bbaf10a63}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90612025-06-30T23:53:21.355ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90622025-06-30T23:53:21.355ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1b14d591-c7a0-4cce-ba32-7d6255d8a795", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
90632025-06-30T23:53:21.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90642025-06-30T23:53:21.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90652025-06-30T23:53:21.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90662025-06-30T23:53:21.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90672025-06-30T23:53:21.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90682025-06-30T23:53:21.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90692025-06-30T23:53:21.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90702025-06-30T23:53:21.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90712025-06-30T23:53:21.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90722025-06-30T23:53:21.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90732025-06-30T23:53:21.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90742025-06-30T23:53:21.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90752025-06-30T23:53:21.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
90762025-06-30T23:53:21.371ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90772025-06-30T23:53:21.372ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2c98713-6b4f-460f-804b-098ef93e87e9", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
90782025-06-30T23:53:21.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90792025-06-30T23:53:21.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
90802025-06-30T23:53:21.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90812025-06-30T23:53:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90822025-06-30T23:53:21.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90832025-06-30T23:53:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90842025-06-30T23:53:21.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90852025-06-30T23:53:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90862025-06-30T23:53:21.380ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90872025-06-30T23:53:21.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90882025-06-30T23:53:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90892025-06-30T23:53:21.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90902025-06-30T23:53:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90912025-06-30T23:53:21.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90922025-06-30T23:53:21.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90932025-06-30T23:53:21.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90942025-06-30T23:53:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90952025-06-30T23:53:21.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90962025-06-30T23:53:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: a349cfe7-e5fd-4604-9ecd-d2a2c17cd357, lookup_type: ById(a349cfe7-e5fd-4604-9ecd-d2a2c17cd357) }, key: c4785cc5-542d-40ba-85bc-bc3ec55d0d6c, lookup_type: ById(c4785cc5-542d-40ba-85bc-bc3ec55d0d6c) } result = Ok(())
90972025-06-30T23:53:21.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90982025-06-30T23:53:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90992025-06-30T23:53:21.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91002025-06-30T23:53:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91012025-06-30T23:53:21.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91022025-06-30T23:53:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91032025-06-30T23:53:21.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91042025-06-30T23:53:21.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: a349cfe7-e5fd-4604-9ecd-d2a2c17cd357, lookup_type: ById(a349cfe7-e5fd-4604-9ecd-d2a2c17cd357) }, key: c4785cc5-542d-40ba-85bc-bc3ec55d0d6c, lookup_type: ById(c4785cc5-542d-40ba-85bc-bc3ec55d0d6c) } result = Ok(())
91052025-06-30T23:53:21.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91062025-06-30T23:53:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91072025-06-30T23:53:21.411ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849/state
91082025-06-30T23:53:21.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91092025-06-30T23:53:21.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91102025-06-30T23:53:21.413ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
91112025-06-30T23:53:21.414ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91122025-06-30T23:53:21.414ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98d1f32e-4dd1-441f-9b9b-bea8f78d122e", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91132025-06-30T23:53:21.414ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91142025-06-30T23:53:21.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91152025-06-30T23:53:21.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91162025-06-30T23:53:21.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91172025-06-30T23:53:21.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91182025-06-30T23:53:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91192025-06-30T23:53:21.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91202025-06-30T23:53:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91212025-06-30T23:53:21.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91222025-06-30T23:53:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91232025-06-30T23:53:21.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91242025-06-30T23:53:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91252025-06-30T23:53:21.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91262025-06-30T23:53:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91272025-06-30T23:53:21.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91282025-06-30T23:53:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: a349cfe7-e5fd-4604-9ecd-d2a2c17cd357, lookup_type: ById(a349cfe7-e5fd-4604-9ecd-d2a2c17cd357) }, key: 05055c2e-e1ee-4def-b86f-cda90760446a, lookup_type: ById(05055c2e-e1ee-4def-b86f-cda90760446a) } result = Ok(())
91292025-06-30T23:53:21.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91302025-06-30T23:53:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91312025-06-30T23:53:21.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91322025-06-30T23:53:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91332025-06-30T23:53:21.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91342025-06-30T23:53:21.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91352025-06-30T23:53:21.438ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
91362025-06-30T23:53:21.438ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91372025-06-30T23:53:21.439ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "267a42d7-4760-49ea-b653-94fce554c7fd", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91382025-06-30T23:53:21.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91392025-06-30T23:53:21.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91402025-06-30T23:53:21.440ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91412025-06-30T23:53:21.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91422025-06-30T23:53:21.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91432025-06-30T23:53:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91442025-06-30T23:53:21.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91452025-06-30T23:53:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91462025-06-30T23:53:21.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91472025-06-30T23:53:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91482025-06-30T23:53:21.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91492025-06-30T23:53:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: a349cfe7-e5fd-4604-9ecd-d2a2c17cd357, lookup_type: ById(a349cfe7-e5fd-4604-9ecd-d2a2c17cd357) }, key: 05055c2e-e1ee-4def-b86f-cda90760446a, lookup_type: ByName("default") } result = Ok(())
91502025-06-30T23:53:21.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91512025-06-30T23:53:21.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91522025-06-30T23:53:21.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91532025-06-30T23:53:21.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91542025-06-30T23:53:21.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91552025-06-30T23:53:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91562025-06-30T23:53:21.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91572025-06-30T23:53:21.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91582025-06-30T23:53:21.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91592025-06-30T23:53:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91602025-06-30T23:53:21.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91612025-06-30T23:53:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91622025-06-30T23:53:21.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91632025-06-30T23:53:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91642025-06-30T23:53:21.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91652025-06-30T23:53:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: a349cfe7-e5fd-4604-9ecd-d2a2c17cd357, lookup_type: ById(a349cfe7-e5fd-4604-9ecd-d2a2c17cd357) }, key: 3c4c4d2c-75e7-4f5f-9b9c-2b9bbaf10a63, lookup_type: ByName("default") } result = Ok(())
91662025-06-30T23:53:21.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91672025-06-30T23:53:21.486ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91682025-06-30T23:53:21.486ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91692025-06-30T23:53:21.486ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4d57db86-1662-4cc0-b54b-8494a4e0505d", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91702025-06-30T23:53:21.488ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.692582ms iteration = 23 status = {}
91712025-06-30T23:53:21.532ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
91722025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "162f914e-0831-420d-b437-9c0f81667296", "content-length": "78", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91732025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
91742025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
91752025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
91762025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
91772025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
91782025-06-30T23:53:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
91792025-06-30T23:53:21.534ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
91802025-06-30T23:53:21.535ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
91812025-06-30T23:53:21.535ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
91822025-06-30T23:53:21.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
91832025-06-30T23:53:21.537ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
91842025-06-30T23:53:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
91852025-06-30T23:53:21.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
91862025-06-30T23:53:21.537ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
91872025-06-30T23:53:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
91882025-06-30T23:53:21.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
91892025-06-30T23:53:21.538ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
91902025-06-30T23:53:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
91912025-06-30T23:53:21.540ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
91922025-06-30T23:53:21.540ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
91932025-06-30T23:53:21.540ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b241919-769d-4af9-a3f7-919ed13f0d8f", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91942025-06-30T23:53:21.542ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91952025-06-30T23:53:21.542ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8f5693f-86e4-4425-87cb-5520ae888cc9", "content-length": "810", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
91962025-06-30T23:53:21.542ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(9330182) }} sled = sock
91972025-06-30T23:53:21.542ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91982025-06-30T23:53:21.542ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91992025-06-30T23:53:21.543ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 516.019847ms iteration = 23 status = {}
92002025-06-30T23:53:21.573ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
92012025-06-30T23:53:21.573ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
92022025-06-30T23:53:21.573ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "678ae8e6-0e4e-48ef-b2a6-cf2d120cf6e8", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
92032025-06-30T23:53:21.588ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
92042025-06-30T23:53:21.588ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
92052025-06-30T23:53:21.589ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a5ca38d-d44d-4cf5-95ad-b3e7f3222763", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
92062025-06-30T23:53:21.591ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 553.260489ms iteration = 23 status = {"errors":[],"sps":[]}
92072025-06-30T23:53:21.596ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92082025-06-30T23:53:21.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "46e04430-e3fb-4b74-b524-13d30cbecb63", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92092025-06-30T23:53:21.596ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92102025-06-30T23:53:21.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d0a3b00b-03ce-4b57-a02d-23903dc688b2", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92112025-06-30T23:53:21.597ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92122025-06-30T23:53:21.598ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92132025-06-30T23:53:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 572.991196ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92142025-06-30T23:53:21.613ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 587.45331ms iteration = 23 status = {}
92152025-06-30T23:53:21.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92162025-06-30T23:53:21.695ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92172025-06-30T23:53:21.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92182025-06-30T23:53:21.697ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 671.831822ms iteration = 23 status = null
92192025-06-30T23:53:21.725ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92202025-06-30T23:53:21.725ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "28d8bcff-2714-4039-b7ae-86bbbb1340ab", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92212025-06-30T23:53:21.725ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92222025-06-30T23:53:21.726ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d86960bc-1a8d-44c0-b312-fd0b829ed388", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92232025-06-30T23:53:21.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92242025-06-30T23:53:21.728ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f6316702-de70-41b5-8b86-1238159c1fef", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92252025-06-30T23:53:21.728ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92262025-06-30T23:53:21.730ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92272025-06-30T23:53:21.730ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 704.629041ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92282025-06-30T23:53:21.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92292025-06-30T23:53:21.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92302025-06-30T23:53:21.766ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
92312025-06-30T23:53:21.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92322025-06-30T23:53:21.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92332025-06-30T23:53:21.779ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
92342025-06-30T23:53:21.779ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
92352025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
92362025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
92372025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92382025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92392025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92402025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92412025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92422025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92432025-06-30T23:53:21.780ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
92442025-06-30T23:53:21.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92452025-06-30T23:53:21.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92462025-06-30T23:53:21.783ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
92472025-06-30T23:53:21.783ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
92482025-06-30T23:53:21.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4b7bf14e-52b6-49a7-9702-8f20330722bf", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
92492025-06-30T23:53:21.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
92502025-06-30T23:53:21.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
92512025-06-30T23:53:21.975ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7855aa41-6541-4f20-bf75-69ae36928a43", "content-length": "682", "date": "Mon, 30 Jun 2025 23:53:21 GMT"} })
92522025-06-30T23:53:21.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92532025-06-30T23:53:21.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92542025-06-30T23:53:21.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92552025-06-30T23:53:21.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92562025-06-30T23:53:21.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92572025-06-30T23:53:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92582025-06-30T23:53:21.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92592025-06-30T23:53:21.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92602025-06-30T23:53:21.994ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 966.843017ms iteration = 23 status = {}
92612025-06-30T23:53:22.020ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
92622025-06-30T23:53:22.020ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
92632025-06-30T23:53:22.053ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
92642025-06-30T23:53:22.053ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:53211
92652025-06-30T23:53:22.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d4f51c2e-3764-4844-9b2e-f6743f71df7d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92662025-06-30T23:53:22.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53211 req_id = 190bb035-b16c-489b-a7a7-e36e056acbb0 roles = RoleSet { roles: {} } uri = /metrics/producers
92672025-06-30T23:53:22.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d4f51c2e-3764-4844-9b2e-f6743f71df7d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92682025-06-30T23:53:22.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53211 req_id = 190bb035-b16c-489b-a7a7-e36e056acbb0 resource = Database result = Ok(()) uri = /metrics/producers
92692025-06-30T23:53:22.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d4f51c2e-3764-4844-9b2e-f6743f71df7d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92702025-06-30T23:53:22.109ZINFOnexus: assigned collector to new producer collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 file = nexus/src/app/oximeter.rs:76 producer_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
92712025-06-30T23:53:22.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 55227 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53211 req_id = 190bb035-b16c-489b-a7a7-e36e056acbb0 response_code = 201 uri = /metrics/producers
92722025-06-30T23:53:22.109ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "190bb035-b16c-489b-a7a7-e36e056acbb0", "content-length": "41", "date": "Mon, 30 Jun 2025 23:53:22 GMT"} })
92732025-06-30T23:53:22.111ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
92742025-06-30T23:53:22.878ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "661093f6-b1df-4603-ae45-445ac06c2e02", "content-length": "131", "date": "Mon, 30 Jun 2025 23:53:22 GMT"} })
92752025-06-30T23:53:22.885ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 sled_id = e3c378dc-191c-4b79-a618-85fa0e1457c7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-06-30T23:53:15.429546408Z }, migration_in: None, migration_out: None } vmm_id = c5ab56ab-92ca-406c-885e-1f75d8d29849
92762025-06-30T23:53:22.885ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 sled_id = e3c378dc-191c-4b79-a618-85fa0e1457c7 vmm_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-06-30T23:53:15.429546408Z }
92772025-06-30T23:53:22.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 roles = RoleSet { roles: {} } sled_id = e3c378dc-191c-4b79-a618-85fa0e1457c7 vmm_id = c5ab56ab-92ca-406c-885e-1f75d8d29849
92782025-06-30T23:53:22.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 resource = Database result = Ok(()) sled_id = e3c378dc-191c-4b79-a618-85fa0e1457c7 vmm_id = c5ab56ab-92ca-406c-885e-1f75d8d29849
92792025-06-30T23:53:22.889ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c79bb5b1-a199-4f95-a7af-5cf540f074e8 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-06-30T23:53:22.878037082Z }
92802025-06-30T23:53:22.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c79bb5b1-a199-4f95-a7af-5cf540f074e8 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92812025-06-30T23:53:22.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c79bb5b1-a199-4f95-a7af-5cf540f074e8 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92822025-06-30T23:53:22.944ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
92832025-06-30T23:53:22.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 66067 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c79bb5b1-a199-4f95-a7af-5cf540f074e8 response_code = 204 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92842025-06-30T23:53:22.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.909960145s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
92852025-06-30T23:53:22.949ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e7282c8-c9ce-4479-9092-f75af49e0e76 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-06-30T23:53:22.949709640Z }
92862025-06-30T23:53:22.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e7282c8-c9ce-4479-9092-f75af49e0e76 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92872025-06-30T23:53:22.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e7282c8-c9ce-4479-9092-f75af49e0e76 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92882025-06-30T23:53:22.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 44911 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6e7282c8-c9ce-4479-9092-f75af49e0e76 response_code = 204 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
92892025-06-30T23:53:23.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee89104a-945f-4ba4-abcb-04622c3674a5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92902025-06-30T23:53:23.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee89104a-945f-4ba4-abcb-04622c3674a5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92912025-06-30T23:53:23.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ee89104a-945f-4ba4-abcb-04622c3674a5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92922025-06-30T23:53:24.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 06be0ddc-c7fd-42d5-abb9-56527a12f6a1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92932025-06-30T23:53:24.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 06be0ddc-c7fd-42d5-abb9-56527a12f6a1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92942025-06-30T23:53:24.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 06be0ddc-c7fd-42d5-abb9-56527a12f6a1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92952025-06-30T23:53:24.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 778 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 65a70910-d54b-474f-8426-7dd71b58e3fa response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
92962025-06-30T23:53:25.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7825c28b-6778-49d7-88e8-e806b89d7b51 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92972025-06-30T23:53:25.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7825c28b-6778-49d7-88e8-e806b89d7b51 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92982025-06-30T23:53:25.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7825c28b-6778-49d7-88e8-e806b89d7b51 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
92992025-06-30T23:53:26.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0ffeb9be-6175-488d-a430-7abb3749233a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93002025-06-30T23:53:26.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0ffeb9be-6175-488d-a430-7abb3749233a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93012025-06-30T23:53:26.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0ffeb9be-6175-488d-a430-7abb3749233a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93022025-06-30T23:53:27.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44e41d4b-75f0-4a02-b556-ed6e431eab74 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93032025-06-30T23:53:27.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44e41d4b-75f0-4a02-b556-ed6e431eab74 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93042025-06-30T23:53:27.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 44e41d4b-75f0-4a02-b556-ed6e431eab74 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93052025-06-30T23:53:28.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a9ec8b5-2d48-4558-8da0-8162df1818d8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93062025-06-30T23:53:28.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a9ec8b5-2d48-4558-8da0-8162df1818d8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93072025-06-30T23:53:28.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7a9ec8b5-2d48-4558-8da0-8162df1818d8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93082025-06-30T23:53:29.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9226018-ee28-466c-9a37-f1aa9965da43 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93092025-06-30T23:53:29.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9226018-ee28-466c-9a37-f1aa9965da43 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93102025-06-30T23:53:29.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9226018-ee28-466c-9a37-f1aa9965da43 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93112025-06-30T23:53:30.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0297aadd-eb48-45f0-8f40-5bb36d99a7ea roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93122025-06-30T23:53:30.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0297aadd-eb48-45f0-8f40-5bb36d99a7ea resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93132025-06-30T23:53:30.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0297aadd-eb48-45f0-8f40-5bb36d99a7ea response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93142025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
93152025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93162025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
93172025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93182025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93192025-06-30T23:53:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93202025-06-30T23:53:31.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93212025-06-30T23:53:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93222025-06-30T23:53:31.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93232025-06-30T23:53:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93242025-06-30T23:53:31.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93252025-06-30T23:53:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93262025-06-30T23:53:31.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93272025-06-30T23:53:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
93282025-06-30T23:53:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93292025-06-30T23:53:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93302025-06-30T23:53:31.057ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
93312025-06-30T23:53:31.057ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.054623ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
93322025-06-30T23:53:31.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93332025-06-30T23:53:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93342025-06-30T23:53:31.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.489497ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93352025-06-30T23:53:31.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c6938c-0101-4a2a-9b9a-53a5bf0eed9b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93362025-06-30T23:53:31.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c6938c-0101-4a2a-9b9a-53a5bf0eed9b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93372025-06-30T23:53:31.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c6938c-0101-4a2a-9b9a-53a5bf0eed9b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93382025-06-30T23:53:32.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c319bb55-c8ad-486f-9c30-a99c96e89c30 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93392025-06-30T23:53:32.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c319bb55-c8ad-486f-9c30-a99c96e89c30 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93402025-06-30T23:53:32.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c319bb55-c8ad-486f-9c30-a99c96e89c30 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93412025-06-30T23:53:32.980ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02782b7b-bec8-4ccc-a318-a8f425f5c4eb uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-06-30T23:53:32.980060583Z }
93422025-06-30T23:53:32.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02782b7b-bec8-4ccc-a318-a8f425f5c4eb roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93432025-06-30T23:53:32.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02782b7b-bec8-4ccc-a318-a8f425f5c4eb resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93442025-06-30T23:53:32.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7807 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 02782b7b-bec8-4ccc-a318-a8f425f5c4eb response_code = 204 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93452025-06-30T23:53:32.988ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8316e02f-28da-41a4-af09-49a9c8139e65 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2025-06-30T23:53:32.988579771Z }
93462025-06-30T23:53:32.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8316e02f-28da-41a4-af09-49a9c8139e65 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93472025-06-30T23:53:32.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8316e02f-28da-41a4-af09-49a9c8139e65 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93482025-06-30T23:53:32.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7021 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8316e02f-28da-41a4-af09-49a9c8139e65 response_code = 204 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93492025-06-30T23:53:33.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8430c43b-34de-4277-9a13-38f296257e0d roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93502025-06-30T23:53:33.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8430c43b-34de-4277-9a13-38f296257e0d resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93512025-06-30T23:53:33.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8430c43b-34de-4277-9a13-38f296257e0d response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93522025-06-30T23:53:34.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 665 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 287f8b7b-12e5-42d2-bfe1-09860c93a699 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
93532025-06-30T23:53:34.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91225751-94fb-4140-9152-f60e92ad3030 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93542025-06-30T23:53:34.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91225751-94fb-4140-9152-f60e92ad3030 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93552025-06-30T23:53:34.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 91225751-94fb-4140-9152-f60e92ad3030 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
93562025-06-30T23:53:35.405ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-06-30T23:53:32.996025953Z }
93572025-06-30T23:53:35.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93582025-06-30T23:53:35.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93592025-06-30T23:53:35.414ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_needs_update = true
93602025-06-30T23:53:35.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93612025-06-30T23:53:35.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93622025-06-30T23:53:35.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93632025-06-30T23:53:35.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93642025-06-30T23:53:35.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93652025-06-30T23:53:35.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93662025-06-30T23:53:35.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93672025-06-30T23:53:35.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93682025-06-30T23:53:35.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93692025-06-30T23:53:35.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93702025-06-30T23:53:35.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93712025-06-30T23:53:35.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Database result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93722025-06-30T23:53:35.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93732025-06-30T23:53:35.427ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: 8351584d-5492-4db6-8a46-4673e7d4a212, lookup_type: ById(8351584d-5492-4db6-8a46-4673e7d4a212) } result = Ok(()) uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93742025-06-30T23:53:35.439ZINFOnexus (dropshot_internal): starting update saga for 8351584d-5492-4db6-8a46-4673e7d4a212 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-06-30T23:53:32.996025953Z }
93752025-06-30T23:53:35.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 33864 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 response_code = 204 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93762025-06-30T23:53:35.441ZDEBGnexus (dropshot_internal): preparing instance-update saga for 8351584d-5492-4db6-8a46-4673e7d4a212... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 83595d15-857d-4f82-a14f-a256f3923929 uri = /vmms/c5ab56ab-92ca-406c-885e-1f75d8d29849
93772025-06-30T23:53:35.441ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update
93782025-06-30T23:53:35.441ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"8351584d-5492-4db6-8a46-4673e7d4a212","lookup_type":{"ById":"8351584d-5492-4db6-8a46-4673e7d4a212"},"parent":{"key":"65e2f4a8-7044-4a8a-881b-f701fb6eb1d7","lookup_type":{"ById":"65e2f4a8-7044-4a8a-881b-f701fb6eb1d7"},"parent":{"key":"be43509f-edca-460b-b4df-029522d2228d","lookup_type":{"ById":"be43509f-edca-460b-b4df-029522d2228d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93792025-06-30T23:53:35.441ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update
93802025-06-30T23:53:35.483ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update
93812025-06-30T23:53:35.484ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93822025-06-30T23:53:35.484ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93832025-06-30T23:53:35.484ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
93842025-06-30T23:53:35.488ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93852025-06-30T23:53:35.488ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
93862025-06-30T23:53:35.491ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93872025-06-30T23:53:35.491ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
93882025-06-30T23:53:35.497ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93892025-06-30T23:53:35.497ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("06c38396-d2bb-49df-aba7-93cf67921a90")) node_id = 0 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
93902025-06-30T23:53:35.500ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
93912025-06-30T23:53:35.500ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
93922025-06-30T23:53:35.513ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update
93932025-06-30T23:53:35.513ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93942025-06-30T23:53:35.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93952025-06-30T23:53:35.516ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93962025-06-30T23:53:35.516ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93972025-06-30T23:53:35.517ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93982025-06-30T23:53:35.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
93992025-06-30T23:53:35.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94002025-06-30T23:53:35.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94012025-06-30T23:53:35.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94022025-06-30T23:53:35.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94032025-06-30T23:53:35.522ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94042025-06-30T23:53:35.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94052025-06-30T23:53:35.524ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94062025-06-30T23:53:35.527ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: 8351584d-5492-4db6-8a46-4673e7d4a212, lookup_type: ById(8351584d-5492-4db6-8a46-4673e7d4a212) } result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94072025-06-30T23:53:35.527ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance updater_id = 06c38396-d2bb-49df-aba7-93cf67921a90
94082025-06-30T23:53:35.527ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94092025-06-30T23:53:35.527ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94102025-06-30T23:53:35.542ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance updater_id = 06c38396-d2bb-49df-aba7-93cf67921a90
94112025-06-30T23:53:35.542ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94122025-06-30T23:53:35.542ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance
94132025-06-30T23:53:35.547ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 locked_gen = Generation(Generation(2)) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = LockInstance updater_id = 06c38396-d2bb-49df-aba7-93cf67921a90
94142025-06-30T23:53:35.547ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94152025-06-30T23:53:35.547ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("06c38396-d2bb-49df-aba7-93cf67921a90")}) node_id = 1 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
94162025-06-30T23:53:35.550ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94172025-06-30T23:53:35.550ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
94182025-06-30T23:53:35.557ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94192025-06-30T23:53:35.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94202025-06-30T23:53:35.559ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94212025-06-30T23:53:35.559ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94222025-06-30T23:53:35.560ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94232025-06-30T23:53:35.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94242025-06-30T23:53:35.562ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94252025-06-30T23:53:35.565ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: 8351584d-5492-4db6-8a46-4673e7d4a212, lookup_type: ById(8351584d-5492-4db6-8a46-4673e7d4a212) } result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94262025-06-30T23:53:35.565ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94272025-06-30T23:53:35.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94282025-06-30T23:53:35.573ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c5ab56ab-92ca-406c-885e-1f75d8d29849, time_created: 2025-06-30T23:53:14.915052Z, time_deleted: None, instance_id: 8351584d-5492-4db6-8a46-4673e7d4a212, sled_id: e3c378dc-191c-4b79-a618-85fa0e1457c7, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-06-30T23:53:32.996025Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-06-30T23:53:12.832664Z, gen: Generation(Generation(3)), propolis_id: Some(c5ab56ab-92ca-406c-885e-1f75d8d29849), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c5ab56ab-92ca-406c-885e-1f75d8d29849 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-06-30T23:53:35.573220603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
94292025-06-30T23:53:35.575ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94302025-06-30T23:53:35.575ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"8351584d-5492-4db6-8a46-4673e7d4a212","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c5ab56ab-92ca-406c-885e-1f75d8d29849"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"8351584d-5492-4db6-8a46-4673e7d4a212","lookup_type":{"ById":"8351584d-5492-4db6-8a46-4673e7d4a212"},"parent":{"key":"65e2f4a8-7044-4a8a-881b-f701fb6eb1d7","lookup_type":{"ById":"65e2f4a8-7044-4a8a-881b-f701fb6eb1d7"},"parent":{"key":"be43509f-edca-460b-b4df-029522d2228d","lookup_type":{"ById":"be43509f-edca-460b-b4df-029522d2228d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"06c38396-d2bb-49df-aba7-93cf67921a90"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"65e2f4a8-7044-4a8a-881b-f701fb6eb1d7","ram_diff":1073741824},"destroy_active_vmm":"c5ab56ab-92ca-406c-885e-1f75d8d29849","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-06-30T23:53:35.573220603Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94312025-06-30T23:53:35.575ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94322025-06-30T23:53:35.579ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94332025-06-30T23:53:35.579ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94342025-06-30T23:53:35.579ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94352025-06-30T23:53:35.579ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94362025-06-30T23:53:35.582ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94372025-06-30T23:53:35.582ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94382025-06-30T23:53:35.584ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94392025-06-30T23:53:35.584ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94402025-06-30T23:53:35.587ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94412025-06-30T23:53:35.587ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81")) node_id = 0 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94422025-06-30T23:53:35.590ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94432025-06-30T23:53:35.590ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94442025-06-30T23:53:35.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c4ba7e95-1c19-43eb-95b4-ec314397e391 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
94452025-06-30T23:53:35.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c4ba7e95-1c19-43eb-95b4-ec314397e391 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
94462025-06-30T23:53:35.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c4ba7e95-1c19-43eb-95b4-ec314397e391 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
94472025-06-30T23:53:35.600ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 parent_lock = UpdaterLock { updater_id: 06c38396-d2bb-49df-aba7-93cf67921a90, locked_gen: Generation(Generation(2)) } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94482025-06-30T23:53:35.600ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = BecomeUpdater
94492025-06-30T23:53:35.601ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = BecomeUpdater
94502025-06-30T23:53:35.613ZDEBGnexus (SagaExecutor): inherited lock from 06c38396-d2bb-49df-aba7-93cf67921a90 to 9e265dfb-7fe5-40a7-b2fc-70d423fc5a81 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 06c38396-d2bb-49df-aba7-93cf67921a90 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = BecomeUpdater updater_id = 9e265dfb-7fe5-40a7-b2fc-70d423fc5a81
94512025-06-30T23:53:35.613ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94522025-06-30T23:53:35.613ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94532025-06-30T23:53:35.613ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81")}) node_id = 1 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94542025-06-30T23:53:35.616ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94552025-06-30T23:53:35.616ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94562025-06-30T23:53:35.619ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94572025-06-30T23:53:35.619ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94582025-06-30T23:53:35.623ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94592025-06-30T23:53:35.623ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94602025-06-30T23:53:35.626ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94612025-06-30T23:53:35.629ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212
94622025-06-30T23:53:35.631ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94632025-06-30T23:53:35.631ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94642025-06-30T23:53:35.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94652025-06-30T23:53:35.639ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94662025-06-30T23:53:35.645ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
94672025-06-30T23:53:35.645ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94682025-06-30T23:53:35.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UpdateNetworkConfig
94692025-06-30T23:53:35.648ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
94702025-06-30T23:53:35.648ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
94712025-06-30T23:53:35.648ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
94722025-06-30T23:53:35.649ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
94732025-06-30T23:53:35.650ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
94742025-06-30T23:53:35.650ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
94752025-06-30T23:53:35.650ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
94762025-06-30T23:53:35.655ZDEBGnexus: notifying dendrite of updates instance_id = Some(8351584d-5492-4db6-8a46-4673e7d4a212 (instance)) switch = switch0
94772025-06-30T23:53:35.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 292212441 } })
94782025-06-30T23:53:35.656ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1179
94792025-06-30T23:53:35.685ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
94802025-06-30T23:53:35.685ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94812025-06-30T23:53:35.686ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be601788-e4ff-4d0f-b3ee-33d80d62111a", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} })
94822025-06-30T23:53:35.686ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94832025-06-30T23:53:35.687ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94842025-06-30T23:53:35.717ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94852025-06-30T23:53:35.717ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94862025-06-30T23:53:35.720ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94872025-06-30T23:53:35.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94882025-06-30T23:53:35.725ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
94892025-06-30T23:53:35.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
94902025-06-30T23:53:35.742ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-06-30T23:53:35.726785Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, time_modified: Some(2025-06-30T23:53:35.726785Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: be43509f-edca-460b-b4df-029522d2228d, time_modified: Some(2025-06-30T23:53:35.726785Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94912025-06-30T23:53:35.742ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94922025-06-30T23:53:35.742ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94932025-06-30T23:53:35.746ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
94942025-06-30T23:53:35.746ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
94952025-06-30T23:53:35.749ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94962025-06-30T23:53:35.749ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UnassignOximeterProducer
94972025-06-30T23:53:35.749ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UnassignOximeterProducer
94982025-06-30T23:53:35.754ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 producer_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
94992025-06-30T23:53:35.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UnassignOximeterProducer
95002025-06-30T23:53:35.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = UnassignOximeterProducer
95012025-06-30T23:53:35.789ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95022025-06-30T23:53:35.789ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/8351584d-5492-4db6-8a46-4673e7d4a212
95032025-06-30T23:53:35.801ZDEBGnexus (SagaExecutor): client response oximeter-collector = 8351584d-5492-4db6-8a46-4673e7d4a212 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/8351584d-5492-4db6-8a46-4673e7d4a212", status: 204, headers: {"x-request-id": "1894c9e3-ed5b-4fbd-a0f1-5fb0b04719f1", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} }) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95042025-06-30T23:53:35.801ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = ab61cc82-0c40-43e5-9ce0-30d732f070d1 producer_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95052025-06-30T23:53:35.801ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95062025-06-30T23:53:35.801ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95072025-06-30T23:53:35.805ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95082025-06-30T23:53:35.805ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95092025-06-30T23:53:35.810ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 lock = UpdaterLock { updater_id: 9e265dfb-7fe5-40a7-b2fc-70d423fc5a81, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-06-30T23:53:35.573220603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95102025-06-30T23:53:35.810ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = CommitInstanceUpdates
95112025-06-30T23:53:35.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = CommitInstanceUpdates
95122025-06-30T23:53:35.855ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 new_runtime = InstanceRuntimeState { time_updated: 2025-06-30T23:53:35.573220603Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95132025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
95142025-06-30T23:53:35.855ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95152025-06-30T23:53:35.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95162025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95172025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
95182025-06-30T23:53:35.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95192025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95202025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95212025-06-30T23:53:35.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95222025-06-30T23:53:35.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95232025-06-30T23:53:35.858ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95242025-06-30T23:53:35.858ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95252025-06-30T23:53:35.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95262025-06-30T23:53:35.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95272025-06-30T23:53:35.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95282025-06-30T23:53:35.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95292025-06-30T23:53:35.861ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95302025-06-30T23:53:35.861ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("8351584d-5492-4db6-8a46-4673e7d4a212"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c5ab56ab-92ca-406c-885e-1f75d8d29849")}) node_id = 7 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95312025-06-30T23:53:35.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95322025-06-30T23:53:35.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95332025-06-30T23:53:35.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95342025-06-30T23:53:35.864ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95352025-06-30T23:53:35.864ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95362025-06-30T23:53:35.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95372025-06-30T23:53:35.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95382025-06-30T23:53:35.867ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95392025-06-30T23:53:35.867ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95402025-06-30T23:53:35.870ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95412025-06-30T23:53:35.870ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95422025-06-30T23:53:35.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95432025-06-30T23:53:35.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95442025-06-30T23:53:35.875ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95452025-06-30T23:53:35.875ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ReleaseSledResources
95462025-06-30T23:53:35.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95472025-06-30T23:53:35.875ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ReleaseSledResources
95482025-06-30T23:53:35.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95492025-06-30T23:53:35.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95502025-06-30T23:53:35.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95512025-06-30T23:53:35.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95522025-06-30T23:53:35.879ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95532025-06-30T23:53:35.879ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95542025-06-30T23:53:35.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95552025-06-30T23:53:35.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95562025-06-30T23:53:35.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95572025-06-30T23:53:35.882ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95582025-06-30T23:53:35.882ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95592025-06-30T23:53:35.885ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 propolis_id = c5ab56ab-92ca-406c-885e-1f75d8d29849 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95602025-06-30T23:53:35.885ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = MarkVmmDeleted
95612025-06-30T23:53:35.886ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = MarkVmmDeleted
95622025-06-30T23:53:35.896ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95632025-06-30T23:53:35.896ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95642025-06-30T23:53:35.896ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95652025-06-30T23:53:35.896ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95662025-06-30T23:53:35.897ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4b05bbc-a75b-45f0-b2cd-2a1e98015ef6", "content-length": "372", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} })
95672025-06-30T23:53:35.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95682025-06-30T23:53:35.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95692025-06-30T23:53:35.899ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95702025-06-30T23:53:35.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95712025-06-30T23:53:35.902ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95722025-06-30T23:53:35.902ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95732025-06-30T23:53:35.907ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95742025-06-30T23:53:35.907ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95752025-06-30T23:53:35.911ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95762025-06-30T23:53:35.911ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95772025-06-30T23:53:35.913ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95782025-06-30T23:53:35.913ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95792025-06-30T23:53:35.915ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95802025-06-30T23:53:35.915ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95812025-06-30T23:53:35.916ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95822025-06-30T23:53:35.920ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: be43509f-edca-460b-b4df-029522d2228d, lookup_type: ById(be43509f-edca-460b-b4df-029522d2228d) }, key: 65e2f4a8-7044-4a8a-881b-f701fb6eb1d7, lookup_type: ById(65e2f4a8-7044-4a8a-881b-f701fb6eb1d7) }, key: 8351584d-5492-4db6-8a46-4673e7d4a212, lookup_type: ById(8351584d-5492-4db6-8a46-4673e7d4a212) } result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95832025-06-30T23:53:35.920ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95842025-06-30T23:53:35.920ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_node = ChainSuccessorSaga
95852025-06-30T23:53:35.925ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update
95862025-06-30T23:53:35.925ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95872025-06-30T23:53:35.925ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95882025-06-30T23:53:35.928ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95892025-06-30T23:53:35.928ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95902025-06-30T23:53:35.932ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95912025-06-30T23:53:35.932ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95922025-06-30T23:53:35.935ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
95932025-06-30T23:53:35.935ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2
95942025-06-30T23:53:35.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95952025-06-30T23:53:35.953ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95962025-06-30T23:53:35.953ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe51f29a-17eb-4327-a8b0-fbdce0a0b1bf", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} })
95972025-06-30T23:53:35.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95982025-06-30T23:53:35.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95992025-06-30T23:53:35.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96002025-06-30T23:53:35.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96012025-06-30T23:53:35.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96022025-06-30T23:53:35.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96032025-06-30T23:53:35.962ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
96042025-06-30T23:53:35.962ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96052025-06-30T23:53:35.962ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4f5a33b8-e15a-4ad5-ba1a-7aed861bd959", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} })
96062025-06-30T23:53:35.964ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 109.259108ms iteration = 24 status = {}
96072025-06-30T23:53:35.981ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96082025-06-30T23:53:35.983ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 saga_name = instance-update saga_result = SagaResult { saga_id: d6c6f9b3-c888-443c-855a-4f639eafa6a2, saga_log: SagaLog { saga_id: d6c6f9b3-c888-443c-855a-4f639eafa6a2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("8351584d-5492-4db6-8a46-4673e7d4a212"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c5ab56ab-92ca-406c-885e-1f75d8d29849")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("8351584d-5492-4db6-8a46-4673e7d4a212"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c5ab56ab-92ca-406c-885e-1f75d8d29849")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("9e265dfb-7fe5-40a7-b2fc-70d423fc5a81")}} }) }
96092025-06-30T23:53:35.983ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = d6c6f9b3-c888-443c-855a-4f639eafa6a2 instance_id = 8351584d-5492-4db6-8a46-4673e7d4a212 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update
96102025-06-30T23:53:35.983ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96112025-06-30T23:53:35.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
96122025-06-30T23:53:35.987ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96132025-06-30T23:53:35.987ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
96142025-06-30T23:53:35.990ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96152025-06-30T23:53:35.990ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
96162025-06-30T23:53:35.990ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96172025-06-30T23:53:35.990ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ac029ab-4f59-4b45-8b9f-0841e3d408c8", "content-length": "691", "date": "Mon, 30 Jun 2025 23:53:35 GMT"} })
96182025-06-30T23:53:35.990ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
96192025-06-30T23:53:35.990ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
96202025-06-30T23:53:35.990ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
96212025-06-30T23:53:35.991ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 136.754914ms iteration = 24 status = {}
96222025-06-30T23:53:35.994ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96232025-06-30T23:53:35.994ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a
96242025-06-30T23:53:36.034ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update sec_id = e7a416d3-841c-4855-bc73-36f56b8a2e99
96252025-06-30T23:53:36.034ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 06c89850-fb21-4d69-8b73-c5950d4f193a saga_name = start-instance-update saga_result = SagaResult { saga_id: 06c89850-fb21-4d69-8b73-c5950d4f193a, saga_log: SagaLog { saga_id: 06c89850-fb21-4d69-8b73-c5950d4f193a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("06c38396-d2bb-49df-aba7-93cf67921a90")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("06c38396-d2bb-49df-aba7-93cf67921a90")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("06c38396-d2bb-49df-aba7-93cf67921a90"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("06c38396-d2bb-49df-aba7-93cf67921a90")}} }) }
96262025-06-30T23:53:36.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b55f67-2658-4691-9ba8-628277489ccb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96272025-06-30T23:53:36.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b55f67-2658-4691-9ba8-628277489ccb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96282025-06-30T23:53:36.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a3b55f67-2658-4691-9ba8-628277489ccb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96292025-06-30T23:53:37.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9350a957-954f-448b-b14f-74d3360398d4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96302025-06-30T23:53:37.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9350a957-954f-448b-b14f-74d3360398d4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96312025-06-30T23:53:37.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9350a957-954f-448b-b14f-74d3360398d4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96322025-06-30T23:53:38.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de082ee-9969-4270-8b3c-b790ad2cd4f6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96332025-06-30T23:53:38.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de082ee-9969-4270-8b3c-b790ad2cd4f6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96342025-06-30T23:53:38.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3de082ee-9969-4270-8b3c-b790ad2cd4f6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96352025-06-30T23:53:39.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 405b2a18-63de-4c0c-b9e5-47782d550612 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96362025-06-30T23:53:39.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 405b2a18-63de-4c0c-b9e5-47782d550612 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96372025-06-30T23:53:39.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 405b2a18-63de-4c0c-b9e5-47782d550612 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96382025-06-30T23:53:40.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08bd8018-bf4b-4913-9613-92a59f9596e1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96392025-06-30T23:53:40.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08bd8018-bf4b-4913-9613-92a59f9596e1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96402025-06-30T23:53:40.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08bd8018-bf4b-4913-9613-92a59f9596e1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96412025-06-30T23:53:41.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
96422025-06-30T23:53:41.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
96432025-06-30T23:53:41.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96442025-06-30T23:53:41.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96452025-06-30T23:53:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96462025-06-30T23:53:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96472025-06-30T23:53:41.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96482025-06-30T23:53:41.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96492025-06-30T23:53:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96502025-06-30T23:53:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96512025-06-30T23:53:41.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96522025-06-30T23:53:41.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96532025-06-30T23:53:41.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96542025-06-30T23:53:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96552025-06-30T23:53:41.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96562025-06-30T23:53:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
96572025-06-30T23:53:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96582025-06-30T23:53:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96592025-06-30T23:53:41.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
96602025-06-30T23:53:41.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.881516ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
96612025-06-30T23:53:41.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.79401ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96622025-06-30T23:53:41.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d66a086b-944a-420f-bcca-656492ca5ce6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96632025-06-30T23:53:41.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d66a086b-944a-420f-bcca-656492ca5ce6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96642025-06-30T23:53:41.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d66a086b-944a-420f-bcca-656492ca5ce6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96652025-06-30T23:53:42.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 71a9634d-5047-4709-93b4-e0f742ff1f89 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96662025-06-30T23:53:42.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 71a9634d-5047-4709-93b4-e0f742ff1f89 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96672025-06-30T23:53:42.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 71a9634d-5047-4709-93b4-e0f742ff1f89 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96682025-06-30T23:53:43.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad40af32-6698-4312-b177-bbd4f59d3ce7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96692025-06-30T23:53:43.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad40af32-6698-4312-b177-bbd4f59d3ce7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96702025-06-30T23:53:43.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ad40af32-6698-4312-b177-bbd4f59d3ce7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96712025-06-30T23:53:44.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 28ae4156-77f7-4fb3-a596-1de3850a5af3 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
96722025-06-30T23:53:44.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a4c5d70-b61b-467c-a2d6-cad574fa6d5b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96732025-06-30T23:53:44.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a4c5d70-b61b-467c-a2d6-cad574fa6d5b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96742025-06-30T23:53:44.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5a4c5d70-b61b-467c-a2d6-cad574fa6d5b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96752025-06-30T23:53:45.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2a00ca0-4586-4ca8-aca1-77c72da4aedb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96762025-06-30T23:53:45.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2a00ca0-4586-4ca8-aca1-77c72da4aedb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96772025-06-30T23:53:45.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f2a00ca0-4586-4ca8-aca1-77c72da4aedb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96782025-06-30T23:53:46.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6cff3d3e-48b3-4dd2-82b6-29fdfefba5db roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96792025-06-30T23:53:46.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6cff3d3e-48b3-4dd2-82b6-29fdfefba5db resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96802025-06-30T23:53:46.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6cff3d3e-48b3-4dd2-82b6-29fdfefba5db response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96812025-06-30T23:53:47.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7b2c2d4-5549-4b95-887d-ddbfb10f7c58 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96822025-06-30T23:53:47.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7b2c2d4-5549-4b95-887d-ddbfb10f7c58 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96832025-06-30T23:53:47.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7b2c2d4-5549-4b95-887d-ddbfb10f7c58 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96842025-06-30T23:53:48.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7cf51a7-92d3-48bd-87ea-dc76d191352b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96852025-06-30T23:53:48.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7cf51a7-92d3-48bd-87ea-dc76d191352b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96862025-06-30T23:53:48.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d7cf51a7-92d3-48bd-87ea-dc76d191352b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96872025-06-30T23:53:49.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6948dd75-5004-4b4e-84b0-653e02fa4cb4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96882025-06-30T23:53:49.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6948dd75-5004-4b4e-84b0-653e02fa4cb4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96892025-06-30T23:53:49.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6948dd75-5004-4b4e-84b0-653e02fa4cb4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96902025-06-30T23:53:50.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 985d81ac-248e-48aa-8cb6-0d94e5aecae6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96912025-06-30T23:53:50.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 985d81ac-248e-48aa-8cb6-0d94e5aecae6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96922025-06-30T23:53:50.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 985d81ac-248e-48aa-8cb6-0d94e5aecae6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
96932025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
96942025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
96952025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
96962025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96972025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96982025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96992025-06-30T23:53:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97002025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
97012025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
97022025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
97032025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97042025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
97052025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97062025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97072025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97082025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
97092025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97102025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
97112025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97122025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
97132025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
97142025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97152025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97162025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97172025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97182025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97192025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97202025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97212025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97222025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97232025-06-30T23:53:51.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97242025-06-30T23:53:51.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 666017439 } })
97252025-06-30T23:53:51.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
97262025-06-30T23:53:51.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97272025-06-30T23:53:51.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 666554201 } })
97282025-06-30T23:53:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97292025-06-30T23:53:51.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
97302025-06-30T23:53:51.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97312025-06-30T23:53:51.030ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.276309ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97322025-06-30T23:53:51.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97332025-06-30T23:53:51.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97342025-06-30T23:53:51.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352025-06-30T23:53:51.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362025-06-30T23:53:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.261512ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97372025-06-30T23:53:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97382025-06-30T23:53:51.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97392025-06-30T23:53:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97402025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97412025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97422025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97432025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
97442025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
97452025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97462025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
97472025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97482025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
97492025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97502025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97512025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97522025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
97532025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97542025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
97552025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97562025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
97572025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97582025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
97592025-06-30T23:53:51.037ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97602025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97612025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
97622025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97632025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
97642025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97652025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97662025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97672025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97682025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97692025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97702025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97712025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97722025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97732025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97742025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97752025-06-30T23:53:51.037ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
97762025-06-30T23:53:51.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 674536516 } })
97772025-06-30T23:53:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97782025-06-30T23:53:51.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97792025-06-30T23:53:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97802025-06-30T23:53:51.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97812025-06-30T23:53:51.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97822025-06-30T23:53:51.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97832025-06-30T23:53:51.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97842025-06-30T23:53:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97852025-06-30T23:53:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97862025-06-30T23:53:51.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.555072ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
97872025-06-30T23:53:51.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.770267ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
97882025-06-30T23:53:51.040ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 677378522 } })
97892025-06-30T23:53:51.041ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
97902025-06-30T23:53:51.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97912025-06-30T23:53:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97922025-06-30T23:53:51.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97932025-06-30T23:53:51.042ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97942025-06-30T23:53:51.042ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97952025-06-30T23:53:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97962025-06-30T23:53:51.042ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.852889ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
97972025-06-30T23:53:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97982025-06-30T23:53:51.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97992025-06-30T23:53:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98002025-06-30T23:53:51.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98012025-06-30T23:53:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98022025-06-30T23:53:51.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98032025-06-30T23:53:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98042025-06-30T23:53:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98052025-06-30T23:53:51.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98062025-06-30T23:53:51.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98072025-06-30T23:53:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98082025-06-30T23:53:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 21.564949ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98092025-06-30T23:53:51.051ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98102025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98112025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98122025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
98132025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98142025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98152025-06-30T23:53:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98162025-06-30T23:53:51.056ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98172025-06-30T23:53:51.056ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.823539ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
98182025-06-30T23:53:51.064ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
98192025-06-30T23:53:51.064ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.294293ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
98202025-06-30T23:53:51.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98212025-06-30T23:53:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98222025-06-30T23:53:51.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98232025-06-30T23:53:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98242025-06-30T23:53:51.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98252025-06-30T23:53:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98262025-06-30T23:53:51.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98272025-06-30T23:53:51.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98282025-06-30T23:53:51.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.643535ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98292025-06-30T23:53:51.089ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98302025-06-30T23:53:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98312025-06-30T23:53:51.089ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98322025-06-30T23:53:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98332025-06-30T23:53:51.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.872579ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98342025-06-30T23:53:51.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98352025-06-30T23:53:51.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98362025-06-30T23:53:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98372025-06-30T23:53:51.093ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98382025-06-30T23:53:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98392025-06-30T23:53:51.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98402025-06-30T23:53:51.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98412025-06-30T23:53:51.094ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
98422025-06-30T23:53:51.094ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 67.330698ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
98432025-06-30T23:53:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98442025-06-30T23:53:51.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98452025-06-30T23:53:51.098ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98462025-06-30T23:53:51.098ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98472025-06-30T23:53:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 61.946763ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98482025-06-30T23:53:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98492025-06-30T23:53:51.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98502025-06-30T23:53:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98512025-06-30T23:53:51.118ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
98522025-06-30T23:53:51.118ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98532025-06-30T23:53:51.118ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ed64f4-ae3d-4ce4-90e7-186f5fb3088a", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
98542025-06-30T23:53:51.118ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98552025-06-30T23:53:51.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98562025-06-30T23:53:51.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98572025-06-30T23:53:51.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
98582025-06-30T23:53:51.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98592025-06-30T23:53:51.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98602025-06-30T23:53:51.129ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.42683ms iteration = 24 status = 0
98612025-06-30T23:53:51.130ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
98622025-06-30T23:53:51.130ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98632025-06-30T23:53:51.130ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6830eeb2-63c3-45f3-bfe4-57b892b10ebb", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
98642025-06-30T23:53:51.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98652025-06-30T23:53:51.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98662025-06-30T23:53:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.207172ms iteration = 27 status = {"physical_disks_added":0}
98672025-06-30T23:53:51.143ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
98682025-06-30T23:53:51.143ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98692025-06-30T23:53:51.144ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "760771aa-fd18-426d-827b-2904ee76bb52", "content-length": "26", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
98702025-06-30T23:53:51.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98712025-06-30T23:53:51.145ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
98722025-06-30T23:53:51.149ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
98732025-06-30T23:53:51.149ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "001a60f2-e347-4c1c-a860-0d72a1c72fa5", "content-length": "78", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
98742025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
98752025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
98762025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
98772025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
98782025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
98792025-06-30T23:53:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
98802025-06-30T23:53:51.151ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
98812025-06-30T23:53:51.152ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
98822025-06-30T23:53:51.152ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
98832025-06-30T23:53:51.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
98842025-06-30T23:53:51.154ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
98852025-06-30T23:53:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
98862025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
98872025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
98882025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
98892025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
98902025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
98912025-06-30T23:53:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
98922025-06-30T23:53:51.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98932025-06-30T23:53:51.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98942025-06-30T23:53:51.189ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
98952025-06-30T23:53:51.189ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
98962025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8225062-6d38-4560-a7b3-850e81d14a88", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
98972025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
98982025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
98992025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6d950d-2218-44d9-89d1-918a3202185e", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99002025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
99012025-06-30T23:53:51.190ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
99022025-06-30T23:53:51.191ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "8784293a-e2af-4a38-be65-da68d4feb14e", "content-length": "81", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99032025-06-30T23:53:51.192ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 154.73087ms iteration = 24 status = {"errors":[],"sps":[]}
99042025-06-30T23:53:51.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99052025-06-30T23:53:51.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99062025-06-30T23:53:51.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99072025-06-30T23:53:51.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99082025-06-30T23:53:51.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99092025-06-30T23:53:51.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99102025-06-30T23:53:51.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99112025-06-30T23:53:51.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99122025-06-30T23:53:51.252ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 225.718331ms iteration = 24 status = {}
99132025-06-30T23:53:51.314ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99142025-06-30T23:53:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99152025-06-30T23:53:51.316ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 289.731052ms iteration = 24 status = null
99162025-06-30T23:53:51.337ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99172025-06-30T23:53:51.337ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf0a7fe-6cf1-4861-ad63-6f1a8d49f759", "content-length": "691", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99182025-06-30T23:53:51.337ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99192025-06-30T23:53:51.337ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99202025-06-30T23:53:51.337ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99212025-06-30T23:53:51.339ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 311.6908ms iteration = 25 status = {}
99222025-06-30T23:53:51.348ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99232025-06-30T23:53:51.348ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99242025-06-30T23:53:51.349ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a48a0add-d7af-4d13-8bec-c247e9101efa", "content-length": "372", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99252025-06-30T23:53:51.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99262025-06-30T23:53:51.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99272025-06-30T23:53:51.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99282025-06-30T23:53:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99292025-06-30T23:53:51.386ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
99302025-06-30T23:53:51.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99312025-06-30T23:53:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99322025-06-30T23:53:51.398ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
99332025-06-30T23:53:51.398ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99342025-06-30T23:53:51.398ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19aacdba-627b-47fa-beaa-bb7ae3ad4522", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99352025-06-30T23:53:51.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99362025-06-30T23:53:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99372025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
99382025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
99392025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99402025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99412025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99422025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99432025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99442025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99452025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99462025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99472025-06-30T23:53:51.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99482025-06-30T23:53:51.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
99492025-06-30T23:53:51.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99502025-06-30T23:53:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99512025-06-30T23:53:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99522025-06-30T23:53:51.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
99532025-06-30T23:53:51.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99542025-06-30T23:53:51.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99552025-06-30T23:53:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99562025-06-30T23:53:51.407ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99572025-06-30T23:53:51.407ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99582025-06-30T23:53:51.411ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4004e913-6974-442b-b6b7-df1a86e1115a", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99592025-06-30T23:53:51.413ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.128774ms iteration = 25 status = {}
99602025-06-30T23:53:51.503ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "022640ee-4366-4f3f-8201-718c3666af55", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99612025-06-30T23:53:51.503ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
99622025-06-30T23:53:51.503ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99632025-06-30T23:53:51.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f5236be-cdf7-483e-94ea-7d75f59ad97d", "content-length": "682", "date": "Mon, 30 Jun 2025 23:53:51 GMT"} })
99642025-06-30T23:53:51.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99652025-06-30T23:53:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99662025-06-30T23:53:51.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99672025-06-30T23:53:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99682025-06-30T23:53:51.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99692025-06-30T23:53:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99702025-06-30T23:53:51.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99712025-06-30T23:53:51.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99722025-06-30T23:53:51.521ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.702812ms iteration = 24 status = {}
99732025-06-30T23:53:51.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4e33d240-0ced-44b9-83f8-e779644d672b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99742025-06-30T23:53:51.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4e33d240-0ced-44b9-83f8-e779644d672b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99752025-06-30T23:53:51.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4e33d240-0ced-44b9-83f8-e779644d672b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99762025-06-30T23:53:52.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 101c7cda-0ae2-44a3-ba09-7b83d97d1c17 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99772025-06-30T23:53:52.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 101c7cda-0ae2-44a3-ba09-7b83d97d1c17 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99782025-06-30T23:53:52.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 101c7cda-0ae2-44a3-ba09-7b83d97d1c17 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99792025-06-30T23:53:53.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34f97725-b838-4341-94ed-331baefde4a5 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99802025-06-30T23:53:53.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34f97725-b838-4341-94ed-331baefde4a5 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99812025-06-30T23:53:53.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34f97725-b838-4341-94ed-331baefde4a5 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99822025-06-30T23:53:54.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 930 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = b4d28999-2f3c-40eb-8349-ef703c3bf944 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
99832025-06-30T23:53:54.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9f6365d-bfc7-4e84-8343-fd342b42abdd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99842025-06-30T23:53:54.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9f6365d-bfc7-4e84-8343-fd342b42abdd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99852025-06-30T23:53:54.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b9f6365d-bfc7-4e84-8343-fd342b42abdd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99862025-06-30T23:53:55.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e564119a-b914-43f6-a70d-650af8730fc7 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99872025-06-30T23:53:55.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e564119a-b914-43f6-a70d-650af8730fc7 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99882025-06-30T23:53:55.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e564119a-b914-43f6-a70d-650af8730fc7 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99892025-06-30T23:53:56.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f194bd15-51fd-4dc4-9d8f-a4c1b0a3fc01 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99902025-06-30T23:53:56.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f194bd15-51fd-4dc4-9d8f-a4c1b0a3fc01 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99912025-06-30T23:53:56.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f194bd15-51fd-4dc4-9d8f-a4c1b0a3fc01 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99922025-06-30T23:53:57.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edc8e29-baaf-46ac-9135-5b2861d1bf13 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99932025-06-30T23:53:57.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edc8e29-baaf-46ac-9135-5b2861d1bf13 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99942025-06-30T23:53:57.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edc8e29-baaf-46ac-9135-5b2861d1bf13 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99952025-06-30T23:53:58.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3e5b1afa-f120-4dc3-a7ba-b279cecc41c9 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99962025-06-30T23:53:58.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3e5b1afa-f120-4dc3-a7ba-b279cecc41c9 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99972025-06-30T23:53:58.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3e5b1afa-f120-4dc3-a7ba-b279cecc41c9 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99982025-06-30T23:54:00.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = acae6dff-29c2-44f6-8922-1234c123c5c6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
99992025-06-30T23:54:00.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = acae6dff-29c2-44f6-8922-1234c123c5c6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100002025-06-30T23:54:00.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = acae6dff-29c2-44f6-8922-1234c123c5c6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100012025-06-30T23:54:01.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34383fb6-8a38-464c-9d34-5609e781c990 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100022025-06-30T23:54:01.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34383fb6-8a38-464c-9d34-5609e781c990 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100032025-06-30T23:54:01.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34383fb6-8a38-464c-9d34-5609e781c990 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100042025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
100052025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100062025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
100072025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100082025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100092025-06-30T23:54:01.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100102025-06-30T23:54:01.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100112025-06-30T23:54:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100122025-06-30T23:54:01.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100132025-06-30T23:54:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100142025-06-30T23:54:01.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100152025-06-30T23:54:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100162025-06-30T23:54:01.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100172025-06-30T23:54:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
100182025-06-30T23:54:01.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100192025-06-30T23:54:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100202025-06-30T23:54:01.054ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
100212025-06-30T23:54:01.054ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.444365ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
100222025-06-30T23:54:01.063ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100232025-06-30T23:54:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100242025-06-30T23:54:01.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.804055ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100252025-06-30T23:54:02.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e454f6d1-e52c-434b-85ee-1124238276da roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100262025-06-30T23:54:02.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e454f6d1-e52c-434b-85ee-1124238276da resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100272025-06-30T23:54:02.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e454f6d1-e52c-434b-85ee-1124238276da response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100282025-06-30T23:54:03.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c58dd8-7238-4541-94d9-04e21312c403 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100292025-06-30T23:54:03.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c58dd8-7238-4541-94d9-04e21312c403 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100302025-06-30T23:54:03.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 09c58dd8-7238-4541-94d9-04e21312c403 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100312025-06-30T23:54:04.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ffcb7e81-2ca6-445d-9771-667e87ae24b8 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100322025-06-30T23:54:04.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ffcb7e81-2ca6-445d-9771-667e87ae24b8 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100332025-06-30T23:54:04.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ffcb7e81-2ca6-445d-9771-667e87ae24b8 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100342025-06-30T23:54:04.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 22c505bd-9987-433b-af83-3970c2cebb7d response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
100352025-06-30T23:54:05.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edca24a-fc21-4f6c-90af-66c0f148d662 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100362025-06-30T23:54:05.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edca24a-fc21-4f6c-90af-66c0f148d662 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100372025-06-30T23:54:05.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7edca24a-fc21-4f6c-90af-66c0f148d662 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100382025-06-30T23:54:06.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5bd3d3d1-45f5-4f21-bdf6-3e0974466c0a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100392025-06-30T23:54:06.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5bd3d3d1-45f5-4f21-bdf6-3e0974466c0a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100402025-06-30T23:54:06.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 5bd3d3d1-45f5-4f21-bdf6-3e0974466c0a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100412025-06-30T23:54:07.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2bd8517a-3720-459a-8ddd-7b408f59573f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100422025-06-30T23:54:07.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2bd8517a-3720-459a-8ddd-7b408f59573f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100432025-06-30T23:54:07.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2bd8517a-3720-459a-8ddd-7b408f59573f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100442025-06-30T23:54:08.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 779a2866-7198-4563-bab3-905d09801cb1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100452025-06-30T23:54:08.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 779a2866-7198-4563-bab3-905d09801cb1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100462025-06-30T23:54:08.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 779a2866-7198-4563-bab3-905d09801cb1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100472025-06-30T23:54:09.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8d7a50db-0f19-44e2-80f9-6bba66db5a1a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100482025-06-30T23:54:09.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8d7a50db-0f19-44e2-80f9-6bba66db5a1a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100492025-06-30T23:54:09.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8d7a50db-0f19-44e2-80f9-6bba66db5a1a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100502025-06-30T23:54:10.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207318c-afc3-4799-a774-b5e75eeea594 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100512025-06-30T23:54:10.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207318c-afc3-4799-a774-b5e75eeea594 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100522025-06-30T23:54:10.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2207318c-afc3-4799-a774-b5e75eeea594 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100532025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
100542025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
100552025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100562025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100572025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100582025-06-30T23:54:11.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100592025-06-30T23:54:11.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602025-06-30T23:54:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100612025-06-30T23:54:11.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100622025-06-30T23:54:11.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100632025-06-30T23:54:11.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100642025-06-30T23:54:11.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100652025-06-30T23:54:11.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100662025-06-30T23:54:11.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
100672025-06-30T23:54:11.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100682025-06-30T23:54:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100692025-06-30T23:54:11.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
100702025-06-30T23:54:11.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.150778ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
100712025-06-30T23:54:11.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100722025-06-30T23:54:11.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100732025-06-30T23:54:11.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.464364ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100742025-06-30T23:54:11.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b2647fb-041e-4820-b2c2-253c248dd91f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100752025-06-30T23:54:11.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b2647fb-041e-4820-b2c2-253c248dd91f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100762025-06-30T23:54:11.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 0b2647fb-041e-4820-b2c2-253c248dd91f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100772025-06-30T23:54:12.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 70726db3-5a7b-4ec9-8c8d-5adc44e4feb6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100782025-06-30T23:54:12.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 70726db3-5a7b-4ec9-8c8d-5adc44e4feb6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100792025-06-30T23:54:12.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 70726db3-5a7b-4ec9-8c8d-5adc44e4feb6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100802025-06-30T23:54:13.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a777e47-ad37-4125-b73a-7ac21167b2ae roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100812025-06-30T23:54:13.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a777e47-ad37-4125-b73a-7ac21167b2ae resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100822025-06-30T23:54:13.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 9a777e47-ad37-4125-b73a-7ac21167b2ae response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100832025-06-30T23:54:14.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32652ee7-0bd3-4b03-9295-5681e6c2d844 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100842025-06-30T23:54:14.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32652ee7-0bd3-4b03-9295-5681e6c2d844 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100852025-06-30T23:54:14.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 32652ee7-0bd3-4b03-9295-5681e6c2d844 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100862025-06-30T23:54:14.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 688 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = b91c6cec-488a-43a4-be7e-b8525992c19c response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
100872025-06-30T23:54:15.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c61b9f5-8319-4ed5-92f5-0fb04556e3f1 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100882025-06-30T23:54:15.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c61b9f5-8319-4ed5-92f5-0fb04556e3f1 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100892025-06-30T23:54:15.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1c61b9f5-8319-4ed5-92f5-0fb04556e3f1 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100902025-06-30T23:54:16.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9b47216-26db-42b2-a1c0-e9f80819cbb0 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100912025-06-30T23:54:16.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9b47216-26db-42b2-a1c0-e9f80819cbb0 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100922025-06-30T23:54:16.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = a9b47216-26db-42b2-a1c0-e9f80819cbb0 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100932025-06-30T23:54:17.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddd8bbec-f6e3-4258-b5dc-ab562f9aa1b6 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100942025-06-30T23:54:17.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddd8bbec-f6e3-4258-b5dc-ab562f9aa1b6 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100952025-06-30T23:54:17.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ddd8bbec-f6e3-4258-b5dc-ab562f9aa1b6 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100962025-06-30T23:54:18.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f9f4e78-8e98-4dfb-9c39-7dbe6e0ed7ca roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100972025-06-30T23:54:18.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f9f4e78-8e98-4dfb-9c39-7dbe6e0ed7ca resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100982025-06-30T23:54:18.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 3f9f4e78-8e98-4dfb-9c39-7dbe6e0ed7ca response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
100992025-06-30T23:54:19.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f314efb9-bd40-41df-a759-7b982fbda7a4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101002025-06-30T23:54:19.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f314efb9-bd40-41df-a759-7b982fbda7a4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101012025-06-30T23:54:19.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f314efb9-bd40-41df-a759-7b982fbda7a4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101022025-06-30T23:54:20.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5913196-a36f-4e4c-aa1c-dbcf3eec4fec roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101032025-06-30T23:54:20.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5913196-a36f-4e4c-aa1c-dbcf3eec4fec resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101042025-06-30T23:54:20.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e5913196-a36f-4e4c-aa1c-dbcf3eec4fec response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
101052025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
101062025-06-30T23:54:21.026ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed
101072025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 34.121\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed"}
101082025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
101092025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
101102025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
101112025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101122025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101132025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
101142025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
101152025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
101162025-06-30T23:54:21.026ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-30 23:44:21.026147348 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
101172025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
101182025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101192025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101202025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
101212025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101222025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101232025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
101242025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101252025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
101262025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101272025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
101282025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101292025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101302025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101312025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101322025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
101332025-06-30T23:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101342025-06-30T23:54:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a599b643-15d6-4e04-9a50-c190de356556.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("f83c5502-8876-4c9e-ac59-0c25fb356a4f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 663799838 } })
101352025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
101362025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
101372025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
101382025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101392025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101402025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101412025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
101422025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
101432025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101442025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101452025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
101462025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101472025-06-30T23:54:21.027ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1eef487b-1336-4a4e-902a-6f86ec2c1fb7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3d7b7f8f-8850-45ac-840e-43b949660306.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("84c363dd-b5f3-4c93-8da3-7aba59c384f4.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 663942511 } })
101482025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
101492025-06-30T23:54:21.027ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
101502025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101512025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
101522025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
101532025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
101542025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101552025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.56\u{b5}s iteration = 17 status = "Disabled"
101562025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
101572025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
101582025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101592025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101602025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101612025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101622025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101632025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101642025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101652025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101662025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101672025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101682025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
101692025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.465014ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
101702025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101712025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101722025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
101732025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.527805ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
101742025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101752025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101762025-06-30T23:54:21.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101772025-06-30T23:54:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101782025-06-30T23:54:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101792025-06-30T23:54:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101802025-06-30T23:54:21.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101812025-06-30T23:54:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101822025-06-30T23:54:21.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101832025-06-30T23:54:21.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 666553281 } })
101842025-06-30T23:54:21.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101852025-06-30T23:54:21.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 666658754 } })
101862025-06-30T23:54:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
101872025-06-30T23:54:21.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
101882025-06-30T23:54:21.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101892025-06-30T23:54:21.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101902025-06-30T23:54:21.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101912025-06-30T23:54:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.346013ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101922025-06-30T23:54:21.031ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-30 23:44:21.026147348 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
101932025-06-30T23:54:21.031ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.779194ms iteration = 13 status = {"expiration":"2025-06-30T23:44:21.026147348Z","pruned":[]}
101942025-06-30T23:54:21.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101952025-06-30T23:54:21.032ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101962025-06-30T23:54:21.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101972025-06-30T23:54:21.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101982025-06-30T23:54:21.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101992025-06-30T23:54:21.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102002025-06-30T23:54:21.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012025-06-30T23:54:21.034ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102022025-06-30T23:54:21.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102032025-06-30T23:54:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102042025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102052025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
102062025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
102072025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
102082025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102092025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
102102025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
102112025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102122025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
102132025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
102142025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
102152025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102162025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102172025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102182025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
102192025-06-30T23:54:21.035ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102202025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102212025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
102222025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
102232025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
102242025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
102252025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
102262025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
102272025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
102282025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102292025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
102302025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102312025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
102322025-06-30T23:54:21.035ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102332025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
102342025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102352025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
102362025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102372025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102382025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102392025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102402025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
102412025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102422025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
102432025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102442025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
102452025-06-30T23:54:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102462025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102472025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102482025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102492025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102502025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102512025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102522025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102532025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102542025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102552025-06-30T23:54:21.037ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
102562025-06-30T23:54:21.038ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 674912065 } })
102572025-06-30T23:54:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102582025-06-30T23:54:21.038ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102592025-06-30T23:54:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102602025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102612025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102622025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
102632025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102642025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102652025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102662025-06-30T23:54:21.039ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102672025-06-30T23:54:21.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102682025-06-30T23:54:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102692025-06-30T23:54:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102702025-06-30T23:54:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102712025-06-30T23:54:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102722025-06-30T23:54:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.146834ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102732025-06-30T23:54:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102742025-06-30T23:54:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102752025-06-30T23:54:21.045ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
102762025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 9.450359ms iteration = 13 status = {"by_rx":{},"error":null}
102772025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102782025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102792025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102802025-06-30T23:54:21.045ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102812025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102822025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102832025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102842025-06-30T23:54:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102852025-06-30T23:54:21.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102862025-06-30T23:54:21.047ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
102872025-06-30T23:54:21.047ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
102882025-06-30T23:54:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.251233ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
102892025-06-30T23:54:21.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102902025-06-30T23:54:21.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102912025-06-30T23:54:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102922025-06-30T23:54:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102932025-06-30T23:54:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.074473ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
102942025-06-30T23:54:21.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102952025-06-30T23:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102962025-06-30T23:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102972025-06-30T23:54:21.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-e3c378dc-191c-4b79-a618-85fa0e1457c7.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1796, tv_nsec: 694345574 } })
102982025-06-30T23:54:21.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
102992025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103002025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103012025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103022025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103032025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103042025-06-30T23:54:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103052025-06-30T23:54:21.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103062025-06-30T23:54:21.064ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
103072025-06-30T23:54:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
103082025-06-30T23:54:21.069ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 33.849973ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"154.0.0","globs_reprocessed":{},"no_receivers":[]}
103092025-06-30T23:54:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103102025-06-30T23:54:21.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103112025-06-30T23:54:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103122025-06-30T23:54:21.075ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103132025-06-30T23:54:21.075ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103142025-06-30T23:54:21.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103152025-06-30T23:54:21.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103162025-06-30T23:54:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103172025-06-30T23:54:21.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103182025-06-30T23:54:21.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103192025-06-30T23:54:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103202025-06-30T23:54:21.078ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103212025-06-30T23:54:21.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103222025-06-30T23:54:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
103232025-06-30T23:54:21.080ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103242025-06-30T23:54:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103252025-06-30T23:54:21.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103262025-06-30T23:54:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103272025-06-30T23:54:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103282025-06-30T23:54:21.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103292025-06-30T23:54:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103302025-06-30T23:54:21.089ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312025-06-30T23:54:21.091ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103332025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103342025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
103352025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103362025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103372025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103382025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103392025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103402025-06-30T23:54:21.093ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103412025-06-30T23:54:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103422025-06-30T23:54:21.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103432025-06-30T23:54:21.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103442025-06-30T23:54:21.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103452025-06-30T23:54:21.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
103462025-06-30T23:54:21.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103472025-06-30T23:54:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103482025-06-30T23:54:21.099ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103492025-06-30T23:54:21.099ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103502025-06-30T23:54:21.099ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103512025-06-30T23:54:21.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103522025-06-30T23:54:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103532025-06-30T23:54:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103542025-06-30T23:54:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
103552025-06-30T23:54:21.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103562025-06-30T23:54:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103572025-06-30T23:54:21.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103582025-06-30T23:54:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103592025-06-30T23:54:21.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103602025-06-30T23:54:21.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103612025-06-30T23:54:21.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103622025-06-30T23:54:21.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103632025-06-30T23:54:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103642025-06-30T23:54:21.108ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 80.758209ms iteration = 6 status = {"nsuccess":5}
103652025-06-30T23:54:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103662025-06-30T23:54:21.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103672025-06-30T23:54:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103682025-06-30T23:54:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 73.609153ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
103692025-06-30T23:54:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.679437ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
103702025-06-30T23:54:21.113ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103712025-06-30T23:54:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.806411ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103722025-06-30T23:54:21.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.793786ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
103732025-06-30T23:54:21.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103742025-06-30T23:54:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
103752025-06-30T23:54:21.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103762025-06-30T23:54:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103772025-06-30T23:54:21.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103782025-06-30T23:54:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103792025-06-30T23:54:21.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103802025-06-30T23:54:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103812025-06-30T23:54:21.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103822025-06-30T23:54:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e3c378dc-191c-4b79-a618-85fa0e1457c7, lookup_type: ById(e3c378dc-191c-4b79-a618-85fa0e1457c7) } result = Ok(())
103832025-06-30T23:54:21.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103842025-06-30T23:54:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103852025-06-30T23:54:21.137ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.851201ms iteration = 25 status = 0
103862025-06-30T23:54:21.137ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
103872025-06-30T23:54:21.137ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
103882025-06-30T23:54:21.137ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.996335ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
103892025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
103902025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
103912025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
103922025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103932025-06-30T23:54:21.140ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103942025-06-30T23:54:21.140ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103952025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.125772ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103962025-06-30T23:54:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103972025-06-30T23:54:21.141ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
103982025-06-30T23:54:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.743082ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
103992025-06-30T23:54:21.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104002025-06-30T23:54:21.142ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
104012025-06-30T23:54:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.841639ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
104022025-06-30T23:54:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104032025-06-30T23:54:21.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104042025-06-30T23:54:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104052025-06-30T23:54:21.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104062025-06-30T23:54:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104072025-06-30T23:54:21.149ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
104082025-06-30T23:54:21.149ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
104092025-06-30T23:54:21.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104102025-06-30T23:54:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104112025-06-30T23:54:21.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104122025-06-30T23:54:21.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.206344ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104132025-06-30T23:54:21.153ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-30T23:42:18.641712Z, time_modified: 2025-06-30T23:42:18.641712Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: be43509f-edca-460b-b4df-029522d2228d, db_silo: Silo { identity: SiloIdentity { id: be43509f-edca-460b-b4df-029522d2228d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-30T23:42:28.000181Z, time_modified: 2025-06-30T23:42:28.000181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c" }] }) }
104142025-06-30T23:54:21.153ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 127.255184ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]}},"default_endpoint":{"silo_id":"be43509f-edca-460b-b4df-029522d2228d","tls_certs":["698d2d515e70e635919353fe3b5b3665845169402524b7a385b3659b961c8f1c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
104152025-06-30T23:54:21.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104162025-06-30T23:54:21.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104172025-06-30T23:54:21.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104182025-06-30T23:54:21.157ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 86467787-cc37-495f-a6f5-4fc34c1be581 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
104192025-06-30T23:54:21.157ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
104202025-06-30T23:54:21.157ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-30 23:42:27.308059 UTC dns_group = internal generation = 1
104212025-06-30T23:54:21.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 131.212395ms iteration = 13 status = {"generation":1}
104222025-06-30T23:54:21.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.980918ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104232025-06-30T23:54:21.163ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
104242025-06-30T23:54:21.163ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 0 version = 2
104252025-06-30T23:54:21.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104262025-06-30T23:54:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104272025-06-30T23:54:21.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104282025-06-30T23:54:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104292025-06-30T23:54:21.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104302025-06-30T23:54:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104312025-06-30T23:54:21.170ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32a529c4-e707-495c-b849-f3ef9b17d36e dns_zone_name = oxide.test found_so_far = 4 version = 2
104322025-06-30T23:54:21.170ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104332025-06-30T23:54:21.170ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-30 23:42:28.056488 UTC dns_group = external generation = 2
104342025-06-30T23:54:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 144.704558ms iteration = 13 status = {"generation":2}
104352025-06-30T23:54:21.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104362025-06-30T23:54:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104372025-06-30T23:54:21.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.008125ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
104382025-06-30T23:54:21.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104392025-06-30T23:54:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104402025-06-30T23:54:21.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104412025-06-30T23:54:21.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104422025-06-30T23:54:21.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104432025-06-30T23:54:21.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104442025-06-30T23:54:21.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104452025-06-30T23:54:21.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104462025-06-30T23:54:21.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104472025-06-30T23:54:21.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104482025-06-30T23:54:21.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
104492025-06-30T23:54:21.210ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104502025-06-30T23:54:21.210ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44b07cb7-d894-46ae-8438-44b10845d3ed", "content-length": "26", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104512025-06-30T23:54:21.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104522025-06-30T23:54:21.212ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104532025-06-30T23:54:21.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
104542025-06-30T23:54:21.227ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 zone_address = fd00:1122:3344:101::2
104552025-06-30T23:54:21.227ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104562025-06-30T23:54:21.227ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eae4d0dc-e9dc-4fca-bd8a-62650f66b1c0", "content-length": "26", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104572025-06-30T23:54:21.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104582025-06-30T23:54:21.229ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.948201ms iteration = 28 status = {"physical_disks_added":0}
104592025-06-30T23:54:21.229ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
104602025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
104612025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ac7d3b3-9677-4dd4-b9b4-58d006376ee7", "content-length": "78", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104622025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
104632025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
104642025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
104652025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
104662025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
104672025-06-30T23:54:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
104682025-06-30T23:54:21.293ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
104692025-06-30T23:54:21.293ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
104702025-06-30T23:54:21.294ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
104712025-06-30T23:54:21.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
104722025-06-30T23:54:21.295ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
104732025-06-30T23:54:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
104742025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
104752025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
104762025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
104772025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
104782025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
104792025-06-30T23:54:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
104802025-06-30T23:54:21.297ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
104812025-06-30T23:54:21.297ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
104822025-06-30T23:54:21.297ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2ed33bb-f797-456a-90d3-a26cd6e86b09", "content-length": "81", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104832025-06-30T23:54:21.298ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
104842025-06-30T23:54:21.298ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
104852025-06-30T23:54:21.298ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fa992fe-d8f6-483b-9702-74aacc365d78", "content-length": "81", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104862025-06-30T23:54:21.303ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
104872025-06-30T23:54:21.303ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 268.04019ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
104882025-06-30T23:54:21.330ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
104892025-06-30T23:54:21.330ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
104902025-06-30T23:54:21.331ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3077035-9604-4a27-9032-e4c40a23eb5a", "content-length": "81", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104912025-06-30T23:54:21.333ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 295.604178ms iteration = 25 status = {"errors":[],"sps":[]}
104922025-06-30T23:54:21.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ccec0805-8eba-48d1-9008-4cf99b757b57 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
104932025-06-30T23:54:21.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
104942025-06-30T23:54:21.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ccec0805-8eba-48d1-9008-4cf99b757b57 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
104952025-06-30T23:54:21.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = ccec0805-8eba-48d1-9008-4cf99b757b57 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
104962025-06-30T23:54:21.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
104972025-06-30T23:54:21.389ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104982025-06-30T23:54:21.389ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38c95e8b-1131-4126-89ed-80d92b421e37", "content-length": "26", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
104992025-06-30T23:54:21.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105002025-06-30T23:54:21.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105012025-06-30T23:54:21.399ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105022025-06-30T23:54:21.400ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ab81040-7acc-42ec-96e5-89b384f4ea84", "content-length": "691", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105032025-06-30T23:54:21.400ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
105042025-06-30T23:54:21.400ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
105052025-06-30T23:54:21.400ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
105062025-06-30T23:54:21.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.33551ms iteration = 26 status = {}
105072025-06-30T23:54:21.432ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105082025-06-30T23:54:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105092025-06-30T23:54:21.434ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 407.918776ms iteration = 25 status = null
105102025-06-30T23:54:21.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
105112025-06-30T23:54:21.445ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105122025-06-30T23:54:21.445ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105132025-06-30T23:54:21.445ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "08b8008e-fe6d-4be7-abd2-fd5927188a2f", "content-length": "372", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105142025-06-30T23:54:21.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105152025-06-30T23:54:21.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105162025-06-30T23:54:21.459ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
105172025-06-30T23:54:21.459ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105182025-06-30T23:54:21.459ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "64ef658c-5716-4f64-a852-4783880fb6c5", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105192025-06-30T23:54:21.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105202025-06-30T23:54:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105212025-06-30T23:54:21.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105222025-06-30T23:54:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105232025-06-30T23:54:21.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105242025-06-30T23:54:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105252025-06-30T23:54:21.468ZINFOnexus (BackgroundTasks): VPC route manager sled e3c378dc-191c-4b79-a618-85fa0e1457c7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105262025-06-30T23:54:21.468ZDEBGnexus (BackgroundTasks): client request SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105272025-06-30T23:54:21.469ZDEBGnexus (BackgroundTasks): client response SledAgent = e3c378dc-191c-4b79-a618-85fa0e1457c7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c2b89327-a36a-462b-b4a3-0cb415416a41", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105282025-06-30T23:54:21.470ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 434.463261ms iteration = 26 status = {}
105292025-06-30T23:54:21.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
105302025-06-30T23:54:21.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f8658001-9814-4f8a-b2bb-a8803635117f", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
105312025-06-30T23:54:21.490ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
105322025-06-30T23:54:21.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0274e1fb-f0fb-482c-a493-638be9635e57", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
105332025-06-30T23:54:21.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
105342025-06-30T23:54:21.494ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
105352025-06-30T23:54:21.494ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 467.979936ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
105362025-06-30T23:54:21.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
105372025-06-30T23:54:21.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "edbb0609-d034-4d10-821d-263f289bdd35", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105382025-06-30T23:54:21.534ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105392025-06-30T23:54:21.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "54361f2e-3a6f-499f-8dab-010618e93809", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105402025-06-30T23:54:21.536ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105412025-06-30T23:54:21.537ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eac2c666-d334-47e2-b5c7-e83d26cd4d76", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105422025-06-30T23:54:21.537ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105432025-06-30T23:54:21.539ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
105442025-06-30T23:54:21.539ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.853637ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
105452025-06-30T23:54:21.590ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 564.815086ms iteration = 25 status = {}
105462025-06-30T23:54:21.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105472025-06-30T23:54:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105482025-06-30T23:54:21.629ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 094347e5-c31a-422c-b1c8-70c38e81b9e7, rack_id: 0c79af55-66f9-41fa-b923-53ba87835167, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(66f8ecbe-e5d0-44fb-9b32-77661e5fe154) } rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
105492025-06-30T23:54:21.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105502025-06-30T23:54:21.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105512025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
105522025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 66f8ecbe-e5d0-44fb-9b32-77661e5fe154
105532025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
105542025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
105552025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105562025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105572025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105582025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105592025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105602025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105612025-06-30T23:54:21.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167
105622025-06-30T23:54:21.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105632025-06-30T23:54:21.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105642025-06-30T23:54:21.644ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch_location = Switch0
105652025-06-30T23:54:21.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
105662025-06-30T23:54:21.745ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b72f1fa3-b701-45fb-8089-40b65a5a3525", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105672025-06-30T23:54:21.745ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 switch = Switch0
105682025-06-30T23:54:21.745ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105692025-06-30T23:54:21.745ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0c79af55-66f9-41fa-b923-53ba87835167 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f393dba9-8c33-4292-9b27-2f8f79bd1646", "content-length": "682", "date": "Mon, 30 Jun 2025 23:54:21 GMT"} })
105702025-06-30T23:54:21.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105712025-06-30T23:54:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105722025-06-30T23:54:21.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105732025-06-30T23:54:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105742025-06-30T23:54:21.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105752025-06-30T23:54:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105762025-06-30T23:54:21.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105772025-06-30T23:54:21.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105782025-06-30T23:54:21.761ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 734.396449ms iteration = 25 status = {}
105792025-06-30T23:54:22.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7c795e6a-53be-4ae9-8bf1-90cb0664d00f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105802025-06-30T23:54:22.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7c795e6a-53be-4ae9-8bf1-90cb0664d00f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105812025-06-30T23:54:22.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7c795e6a-53be-4ae9-8bf1-90cb0664d00f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105822025-06-30T23:54:23.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66852638-493a-4780-b2f3-c3f14d586b46 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105832025-06-30T23:54:23.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66852638-493a-4780-b2f3-c3f14d586b46 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105842025-06-30T23:54:23.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 66852638-493a-4780-b2f3-c3f14d586b46 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105852025-06-30T23:54:24.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 53a6ccc2-c76d-4791-8830-de2afe43df0f response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
105862025-06-30T23:54:24.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f22b1ab6-9c4e-4454-aeec-cae17ac1a7d4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105872025-06-30T23:54:24.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f22b1ab6-9c4e-4454-aeec-cae17ac1a7d4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105882025-06-30T23:54:24.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = f22b1ab6-9c4e-4454-aeec-cae17ac1a7d4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105892025-06-30T23:54:25.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7766a0be-ddd7-465c-a78e-e6b8274b4cbe roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105902025-06-30T23:54:25.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7766a0be-ddd7-465c-a78e-e6b8274b4cbe resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105912025-06-30T23:54:25.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 7766a0be-ddd7-465c-a78e-e6b8274b4cbe response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105922025-06-30T23:54:26.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 12187951-bf23-4647-9b3c-e4de295d8d0e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105932025-06-30T23:54:26.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 12187951-bf23-4647-9b3c-e4de295d8d0e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105942025-06-30T23:54:26.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 12187951-bf23-4647-9b3c-e4de295d8d0e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105952025-06-30T23:54:27.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f7c2dd3-d47b-4356-a167-d293767532b2 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105962025-06-30T23:54:27.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f7c2dd3-d47b-4356-a167-d293767532b2 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105972025-06-30T23:54:27.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 6f7c2dd3-d47b-4356-a167-d293767532b2 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105982025-06-30T23:54:28.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2c6f19ec-7f3c-492e-a675-5e2ffbf49383 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
105992025-06-30T23:54:28.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2c6f19ec-7f3c-492e-a675-5e2ffbf49383 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106002025-06-30T23:54:28.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2c6f19ec-7f3c-492e-a675-5e2ffbf49383 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106012025-06-30T23:54:29.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523d00a2-6012-4b40-bfa6-1ac123c799cd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106022025-06-30T23:54:29.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523d00a2-6012-4b40-bfa6-1ac123c799cd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106032025-06-30T23:54:29.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 523d00a2-6012-4b40-bfa6-1ac123c799cd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106042025-06-30T23:54:30.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8914adde-fb7d-4500-bf10-d5b6a9003b8e roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106052025-06-30T23:54:30.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8914adde-fb7d-4500-bf10-d5b6a9003b8e resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106062025-06-30T23:54:30.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8914adde-fb7d-4500-bf10-d5b6a9003b8e response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106072025-06-30T23:54:31.027ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
106082025-06-30T23:54:31.027ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
106092025-06-30T23:54:31.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106102025-06-30T23:54:31.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106112025-06-30T23:54:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106122025-06-30T23:54:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106132025-06-30T23:54:31.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106142025-06-30T23:54:31.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106152025-06-30T23:54:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106162025-06-30T23:54:31.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.972085ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106172025-06-30T23:54:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106182025-06-30T23:54:31.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106192025-06-30T23:54:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106202025-06-30T23:54:31.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106212025-06-30T23:54:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106222025-06-30T23:54:31.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106232025-06-30T23:54:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
106242025-06-30T23:54:31.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106252025-06-30T23:54:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106262025-06-30T23:54:31.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
106272025-06-30T23:54:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.894837ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
106282025-06-30T23:54:31.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d270a6ae-3030-415b-9432-f80253518375 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106292025-06-30T23:54:31.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d270a6ae-3030-415b-9432-f80253518375 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106302025-06-30T23:54:31.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = d270a6ae-3030-415b-9432-f80253518375 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106312025-06-30T23:54:32.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e417802-b7d2-40fb-a002-3c0668100156 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106322025-06-30T23:54:32.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e417802-b7d2-40fb-a002-3c0668100156 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106332025-06-30T23:54:32.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 2e417802-b7d2-40fb-a002-3c0668100156 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106342025-06-30T23:54:33.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 276a40da-b598-4665-a186-1cbe67b8162b roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106352025-06-30T23:54:33.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 276a40da-b598-4665-a186-1cbe67b8162b resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106362025-06-30T23:54:33.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 276a40da-b598-4665-a186-1cbe67b8162b response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106372025-06-30T23:54:34.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 637 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 7398c91e-ee55-4ccd-998b-63922e73a13c response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
106382025-06-30T23:54:34.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1c7bda6-2ea8-437a-bb97-72b6cf9a022a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106392025-06-30T23:54:34.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1c7bda6-2ea8-437a-bb97-72b6cf9a022a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106402025-06-30T23:54:34.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c1c7bda6-2ea8-437a-bb97-72b6cf9a022a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106412025-06-30T23:54:35.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b7ad9d59-3f68-4a5f-8788-8ad3034419ca roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106422025-06-30T23:54:35.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b7ad9d59-3f68-4a5f-8788-8ad3034419ca resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106432025-06-30T23:54:35.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = b7ad9d59-3f68-4a5f-8788-8ad3034419ca response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106442025-06-30T23:54:36.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08da87ac-4fd6-432a-a4ca-44a5274fef46 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106452025-06-30T23:54:36.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08da87ac-4fd6-432a-a4ca-44a5274fef46 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106462025-06-30T23:54:36.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 08da87ac-4fd6-432a-a4ca-44a5274fef46 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106472025-06-30T23:54:37.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57068564-929b-42fb-bb43-1e9f8f9ea35f roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106482025-06-30T23:54:37.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57068564-929b-42fb-bb43-1e9f8f9ea35f resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106492025-06-30T23:54:37.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 57068564-929b-42fb-bb43-1e9f8f9ea35f response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106502025-06-30T23:54:38.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 00780702-5473-4ecd-89c4-47079a8c07cd roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106512025-06-30T23:54:38.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 00780702-5473-4ecd-89c4-47079a8c07cd resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106522025-06-30T23:54:38.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 00780702-5473-4ecd-89c4-47079a8c07cd response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106532025-06-30T23:54:39.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c41f3a1c-c076-4f4e-89ca-dab7f8d32210 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106542025-06-30T23:54:39.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c41f3a1c-c076-4f4e-89ca-dab7f8d32210 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106552025-06-30T23:54:39.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = c41f3a1c-c076-4f4e-89ca-dab7f8d32210 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106562025-06-30T23:54:40.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34d357b7-5696-4150-a40a-95091a3e042c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106572025-06-30T23:54:40.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34d357b7-5696-4150-a40a-95091a3e042c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106582025-06-30T23:54:40.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 34d357b7-5696-4150-a40a-95091a3e042c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106592025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
106602025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
106612025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106622025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106632025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106642025-06-30T23:54:41.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106652025-06-30T23:54:41.030ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106662025-06-30T23:54:41.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106672025-06-30T23:54:41.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106682025-06-30T23:54:41.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.91651ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106692025-06-30T23:54:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106702025-06-30T23:54:41.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106712025-06-30T23:54:41.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106722025-06-30T23:54:41.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106732025-06-30T23:54:41.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106742025-06-30T23:54:41.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106752025-06-30T23:54:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b03b40a0-992b-4c35-94cf-4ad4440a0fed, lookup_type: ById(b03b40a0-992b-4c35-94cf-4ad4440a0fed) } result = Ok(())
106762025-06-30T23:54:41.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106772025-06-30T23:54:41.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106782025-06-30T23:54:41.050ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed original_time_created = 2025-06-30 23:42:20.674585 UTC target_id = b03b40a0-992b-4c35-94cf-4ad4440a0fed time_created = 2025-06-30 23:42:20.674585 UTC
106792025-06-30T23:54:41.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.300246ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b03b40a0-992b-4c35-94cf-4ad4440a0fed","time_created":"2025-06-30T23:42:20.674585Z"}
106802025-06-30T23:54:41.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42070e1f-8077-47a1-9b04-176a19597a1c roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106812025-06-30T23:54:41.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42070e1f-8077-47a1-9b04-176a19597a1c resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106822025-06-30T23:54:41.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 42070e1f-8077-47a1-9b04-176a19597a1c response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106832025-06-30T23:54:42.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bd590f4b-4e83-415a-9635-52749e42f9f4 roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106842025-06-30T23:54:42.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bd590f4b-4e83-415a-9635-52749e42f9f4 resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106852025-06-30T23:54:42.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = bd590f4b-4e83-415a-9635-52749e42f9f4 response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106862025-06-30T23:54:43.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8632230a-8b75-4fc4-85d8-6c36b40c7afb roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106872025-06-30T23:54:43.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8632230a-8b75-4fc4-85d8-6c36b40c7afb resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106882025-06-30T23:54:43.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 8632230a-8b75-4fc4-85d8-6c36b40c7afb response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106892025-06-30T23:54:44.336ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 586 local_addr = [fd00:1122:3344:101::b]:60892 method = GET remote_addr = [fd00:1122:3344:101::d]:56227 req_id = 695f0684-91e6-404a-b7b0-300476a4b4c2 response_code = 200 uri = /e7a416d3-841c-4855-bc73-36f56b8a2e99
106902025-06-30T23:54:44.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e161169e-4e60-4d9e-8624-7bf68804c7ec roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106912025-06-30T23:54:44.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e161169e-4e60-4d9e-8624-7bf68804c7ec resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106922025-06-30T23:54:44.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = e161169e-4e60-4d9e-8624-7bf68804c7ec response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106932025-06-30T23:54:45.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fa8547c-8d52-4bce-84e1-abe2b8b7a52a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106942025-06-30T23:54:45.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fa8547c-8d52-4bce-84e1-abe2b8b7a52a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106952025-06-30T23:54:45.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 1fa8547c-8d52-4bce-84e1-abe2b8b7a52a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106962025-06-30T23:54:46.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4a52f84b-d824-4d25-aa49-584be153a39a roles = RoleSet { roles: {} } uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106972025-06-30T23:54:46.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4a52f84b-d824-4d25-aa49-584be153a39a resource = Database result = Ok(()) uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7
106982025-06-30T23:54:46.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65070 req_id = 4a52f84b-d824-4d25-aa49-584be153a39a response_code = 200 uri = /probes/e3c378dc-191c-4b79-a618-85fa0e1457c7